-- Logs begin at Fri 2022-07-29 03:28:38 UTC, end at Fri 2022-07-29 05:06:41 UTC. -- Jul 29 04:28:31.987321 dv-cinder-851449-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 29 04:28:31.997678 dv-cinder-851449-2-smb devstack@keystone.service[80384]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 29 04:28:31.998825 dv-cinder-851449-2-smb devstack@keystone.service[80384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 04:28:31 2022] *** Jul 29 04:28:31.999012 dv-cinder-851449-2-smb devstack@keystone.service[80384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 04:28:31.999173 dv-cinder-851449-2-smb devstack@keystone.service[80384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 04:28:31.999331 dv-cinder-851449-2-smb devstack@keystone.service[80384]: nodename: dv-cinder-851449-2-smb Jul 29 04:28:31.999492 dv-cinder-851449-2-smb devstack@keystone.service[80384]: machine: x86_64 Jul 29 04:28:31.999648 dv-cinder-851449-2-smb devstack@keystone.service[80384]: clock source: unix Jul 29 04:28:31.999793 dv-cinder-851449-2-smb devstack@keystone.service[80384]: pcre jit disabled Jul 29 04:28:31.999944 dv-cinder-851449-2-smb devstack@keystone.service[80384]: detected number of CPU cores: 4 Jul 29 04:28:32.000096 dv-cinder-851449-2-smb devstack@keystone.service[80384]: current working directory: / Jul 29 04:28:32.000249 dv-cinder-851449-2-smb devstack@keystone.service[80384]: detected binary path: /usr/bin/uwsgi-core Jul 29 04:28:32.000407 dv-cinder-851449-2-smb devstack@keystone.service[80384]: your processes number limit is 47680 Jul 29 04:28:32.000566 dv-cinder-851449-2-smb devstack@keystone.service[80384]: your memory page size is 4096 bytes Jul 29 04:28:32.001642 dv-cinder-851449-2-smb devstack@keystone.service[80384]: detected max file descriptor number: 2048 Jul 29 04:28:32.001642 dv-cinder-851449-2-smb devstack@keystone.service[80384]: lock engine: pthread robust mutexes Jul 29 04:28:32.001642 dv-cinder-851449-2-smb devstack@keystone.service[80384]: thunder lock: enabled Jul 29 04:28:32.001642 dv-cinder-851449-2-smb devstack@keystone.service[80384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 29 04:28:32.001642 dv-cinder-851449-2-smb devstack@keystone.service[80384]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 04:28:32.039700 dv-cinder-851449-2-smb devstack@keystone.service[80384]: Python main interpreter initialized at 0x55fec2ea99c0 Jul 29 04:28:32.039700 dv-cinder-851449-2-smb devstack@keystone.service[80384]: python threads support enabled Jul 29 04:28:32.039700 dv-cinder-851449-2-smb devstack@keystone.service[80384]: your server socket listen backlog is limited to 100 connections Jul 29 04:28:32.039700 dv-cinder-851449-2-smb devstack@keystone.service[80384]: your mercy for graceful operations on workers is 90 seconds Jul 29 04:28:32.040023 dv-cinder-851449-2-smb devstack@keystone.service[80384]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 04:28:32.040127 dv-cinder-851449-2-smb devstack@keystone.service[80384]: *** Operational MODE: preforking *** Jul 29 04:28:32.040645 dv-cinder-851449-2-smb devstack@keystone.service[80384]: *** uWSGI is running in multiple interpreter mode *** Jul 29 04:28:32.040645 dv-cinder-851449-2-smb devstack@keystone.service[80384]: spawned uWSGI master process (pid: 80384) Jul 29 04:28:32.040837 dv-cinder-851449-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 29 04:28:32.043086 dv-cinder-851449-2-smb devstack@keystone.service[80384]: spawned uWSGI worker 1 (pid: 80397, cores: 1) Jul 29 04:28:32.043086 dv-cinder-851449-2-smb devstack@keystone.service[80384]: spawned uWSGI worker 2 (pid: 80398, cores: 1) Jul 29 04:28:32.043086 dv-cinder-851449-2-smb devstack@keystone.service[80384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 04:28:37.568589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:28:37.568589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Jul 29 04:28:37.569398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:28:37.569398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Jul 29 04:28:37.569687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:28:37.569687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: from cryptography.utils import int_from_bytes Jul 29 04:28:37.570142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:28:37.570142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: from cryptography.utils import int_from_bytes Jul 29 04:28:37.619245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 04:28:37.619442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 04:28:37.619633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] command line args: [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 04:28:37.619727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 04:28:37.619807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 04:28:37.619926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 04:28:37.620021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] command line args: [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 04:28:37.620098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ================================================================================ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 04:28:37.620251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 04:28:37.620329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.620428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ================================================================================ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 04:28:37.620565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_dir = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.620682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] admin_token = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.620766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.620924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_source = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config_dir = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] debug = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] config_source = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] debug = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.621877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_config_append = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.622973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_config_append = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_dir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_dir = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.623961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.624927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.625982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.626066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.626230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.626313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.626473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.626558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.626750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] publish_errors = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] publish_errors = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.627952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] standard_threads = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] standard_threads = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.628928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_journal = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_json = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_journal = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_json = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_stderr = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.629900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_stderr = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.630032 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_syslog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.630114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] use_syslog = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.630185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.630295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:28:37.630419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.630548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.630678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.631382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.631463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.631642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.631718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.631881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.631966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.632928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.633921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.634941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.635979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.636973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.637999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.638935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.639884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.640941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.641972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.642884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.643985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.644936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.645900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.646865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.647851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.648946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.649993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.650925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.651962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.652950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.653977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.654921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.external = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.655870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.external = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.password = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.token = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.password = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.656995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] auth.token = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.657985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658709 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.658960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.659945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.660898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.661965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.662980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.663939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664402 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.664884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.665062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.665139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.665297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.665381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.665836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.665925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.666878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667129 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.667988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.668930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.669992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.670954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.671887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.672985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.673962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.674899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.675900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.676999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.677086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.677226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.677305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.677469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.678965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.679986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.680929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.681885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.682882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.683894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.684842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.685976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.686990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.687930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.688894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.689892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.690989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.691977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.692940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.693017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.693206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.693800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.694997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.695938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.696906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.697964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.698939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.699970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700845 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.700923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.701904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.702858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.703966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.704949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.705917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.706931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.707727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 04:28:37.707807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.708015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.708242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.708480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.708718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:28:37.708902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 04:28:37.736484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.736616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.736708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.736785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.736927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.737013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.745721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.745906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.776133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.776359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.776554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.776791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.830044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.830176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.880154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.880386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.881584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.881839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.947725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.947988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.948953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.949161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.973307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.973425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.973538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.973647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.973787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.973868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.974777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.985844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.985992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.998671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.998884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.998991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:37.999955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:38.000033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:38.000169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 29 04:28:38.017425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.017666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 04:28:38.017828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.018001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.018098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 04:28:38.018200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 04:28:38.018358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.018466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.018543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 29 04:28:38.018723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.018810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.018977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.019056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.019229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.019306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.019545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.029447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.029759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.029852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.030033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.030117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.030308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.030390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.030593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.037204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.037520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.042162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.042443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.042526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.042727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.042810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.043909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.044962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.045154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.067571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.067934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.069571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.069872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.069968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.070245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.074461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.074740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.074860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.075021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.075139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.075422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.081617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.081857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.082071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.082352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.086150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.086436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.086559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.086727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.086843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.087982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.088126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.088262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.088540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.104396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.104675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.105021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.105301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.108548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.109196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.111700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.111997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.112383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.112680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.116398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.117102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.119583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.120360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.122733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.123033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.123321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.123540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.123626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.123820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.123916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.124108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.124189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.124395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.124674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.124984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.140383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.140677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.140947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.141222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.141367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.141687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.141954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.142223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.148164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.149161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.149713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.150002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.150722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.151007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.152791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.153071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.153362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.153667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.153835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.153955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.154117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.154407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.154688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.154977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.165245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.165798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.166082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.166361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.166632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.166729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.166902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.166983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.167180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.167260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.167461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.167743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.168022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.168310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.183081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.184378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.186033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.187401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.188960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.190357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.191403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.192801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.193011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.193346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.193651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.194492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.194777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.195062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.200049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.201490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.201673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.203109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.204567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.204856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.205142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.205417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.206066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.206360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.206646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.206924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.213948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.214234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.214515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.215483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.215777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.216062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.221273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.221554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.221868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.222153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.222428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.222708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.222924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 29 04:28:38.223005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.223205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.223288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.223498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.223577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.223788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.223875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.224942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.225021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.225314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.225616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.225930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.226197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.226475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.226740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 29 04:28:38.258442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fec2ea99c0 pid: 80398 (default app) Jul 29 04:28:38.260580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fec2ea99c0 pid: 80397 (default app) Jul 29 04:28:38.261704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657bea-ddd9-476b-bee1-97d651446fd2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:38.261999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657bea-ddd9-476b-bee1-97d651446fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:38.262277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657bea-ddd9-476b-bee1-97d651446fd2 None None] PATH_INFO: `/v3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:38.266640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Fri Jul 29 04:28:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:45.837541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:45.838142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:45.838142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:45.842604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:45.847732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:45.848137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:45.848285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:45.919198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: INFO dbcounter [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] Registered counter for database keystone Jul 29 04:28:45.940576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG oslo_db.sqlalchemy.engines [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:28:45.947540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writer thread running {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:28:46.131421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 29 04:28:46.131753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 29 04:28:46.186282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:46.187909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:46.330361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 29 04:28:46.469314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:46.538732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: INFO dbcounter [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] Registered counter for database keystone Jul 29 04:28:46.557690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG oslo_db.sqlalchemy.engines [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:28:46.563779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writer thread running {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:28:46.681401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613ab2-18fd-422a-ada7-dde6b822a471 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:46.685896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:46.686545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:46.686832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:46.687112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:46.695156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:46.746281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 29 04:28:46.746624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4207f64-1c36-49d5-957e-2829d3881d8f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:46.756195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Fri Jul 29 04:28:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:28:46.762131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:46.776834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3c1f8-ba78-4fea-a96e-c3f443436df3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:46.781230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:46.782365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:46.782654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:46.782935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] PATH_INFO: `/v3/projects/c3845060db6a456e8e10c94484cbc67c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:46.784417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] RBAC: Authorizing `identity:get_project(project_id=c3845060db6a456e8e10c94484cbc67c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:46.835037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 29 04:28:46.835377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbfad7-edf5-43a2-a2fe-ad04f5e5baaf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:46.839967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Fri Jul 29 04:28:46 2022] GET /identity/v3/projects/c3845060db6a456e8e10c94484cbc67c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:48.860514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044899-a1ea-494a-8e34-95bb08a688e1 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:48.861049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044899-a1ea-494a-8e34-95bb08a688e1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:48.861049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa044899-a1ea-494a-8e34-95bb08a688e1 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:48.865235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:48.870537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:48.870969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:48.871100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:48.890769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:48.892289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:48.900629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 29 04:28:48.922686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa044899-a1ea-494a-8e34-95bb08a688e1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:48.934667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa044899-a1ea-494a-8e34-95bb08a688e1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:48.938830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47b82-46f0-42e8-b189-a4e8c3b4d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:48.939435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47b82-46f0-42e8-b189-a4e8c3b4d5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:48.939716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47b82-46f0-42e8-b189-a4e8c3b4d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:48.939991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47b82-46f0-42e8-b189-a4e8c3b4d5ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:48.947619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e47b82-46f0-42e8-b189-a4e8c3b4d5ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:48.949425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e47b82-46f0-42e8-b189-a4e8c3b4d5ba admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:48.958051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Fri Jul 29 04:28:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:28:48.963972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:48.972999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7458c8-4e29-4b9d-8252-833393817578 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:48.977926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8068888-72b1-42de-bf3b-d1c688807fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:48.978554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068888-72b1-42de-bf3b-d1c688807fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:48.978841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068888-72b1-42de-bf3b-d1c688807fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:48.979122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068888-72b1-42de-bf3b-d1c688807fb5 admin admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:48.980509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8068888-72b1-42de-bf3b-d1c688807fb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:48.982369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8068888-72b1-42de-bf3b-d1c688807fb5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:48.983908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Fri Jul 29 04:28:48 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:51.037263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5c70-5b25-4998-bd59-7f30f8c6f2c3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.037798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5c70-5b25-4998-bd59-7f30f8c6f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.037903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b5c70-5b25-4998-bd59-7f30f8c6f2c3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.039247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:51.044460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.044846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.045090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.060663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ce5b-4cb9-43ff-a52d-e27e1b8124fc None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.060948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ce5b-4cb9-43ff-a52d-e27e1b8124fc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.061223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ce5b-4cb9-43ff-a52d-e27e1b8124fc None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.062556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:28:51.064616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:51.065855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:51.067591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.067874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.068753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.109856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG passlib.handlers.bcrypt [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80397) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 29 04:28:51.110277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG passlib.handlers.bcrypt [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80397) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 29 04:28:51.145473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:51.156530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:51.158130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:51.168424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.192220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.257691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:28:51.271770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94222cf-68ff-4696-ba7e-5e1b11c7c8bd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.279546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.304996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.305674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.305962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.306246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.317188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:28:51.326586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:28:51.327540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:28:51.328324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:28:51.333413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.383293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a322a36-2e30-4a1a-9b84-b4ef5486cc42 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.385538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.417762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.423308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.424178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.424473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.424751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.436466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbf113-57c2-45dc-8eae-f3a2a992a6e1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.471697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.472286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.472575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.472857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.473722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:51.474036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:51.475961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:51.487736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:51.493829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.498484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:51.499995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:51.592183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ce271-5a05-40ce-91ae-75a28e7ca131 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.596254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 04:28:51.602608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.605871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.706477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ba1a-8195-4050-8a6c-a03232732161 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.731630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.732204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.732489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.732768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.733975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:51.735409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:51.736990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:51.742432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.742902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.743345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.743636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.743913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.758371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.763915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:51.765371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:28:51.783100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:28:51.783955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:28:51.785025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:28:51.785025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:28:51.785025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:28:51.785025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:28:51.785025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:28:51.789977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.843325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619f28-9a4d-4e8c-8a8a-f4fbb9928ae1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.844586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.877489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.878156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.878441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.878717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.879878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:51.881943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:51.883520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:51.889080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c4cc-c1c5-47d6-a02d-f30175c0021b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:51.889202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:51.923122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:51.923752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:51.924040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:51.924328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:51.925043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:51.925352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:51.926804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b23a-0ae0-49c4-a11a-1a82b8f7a97c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:51.944958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:51.971255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:51.992300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a134c7-8eb8-41a3-a968-4fb59f814fbb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:52.027964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fed281-4f28-489d-8000-622147985081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:52.028595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fed281-4f28-489d-8000-622147985081 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:52.028877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fed281-4f28-489d-8000-622147985081 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:52.029154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fed281-4f28-489d-8000-622147985081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:52.029988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fed281-4f28-489d-8000-622147985081 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.domain.id=default, user.id=3b17a7a10c4d4b0096fc893a4bc53a62) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:52.030300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fed281-4f28-489d-8000-622147985081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:52.031753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fed281-4f28-489d-8000-622147985081 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:52.039659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Fri Jul 29 04:28:51 2022] GET /identity/v3/role_assignments?user.id=3b17a7a10c4d4b0096fc893a4bc53a62&scope.domain.id=default&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:54.418546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071b164-99b9-4079-bc05-3f1ef9a25a66 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.419052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071b164-99b9-4079-bc05-3f1ef9a25a66 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.419125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071b164-99b9-4079-bc05-3f1ef9a25a66 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.420421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:54.435029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3c8e-e5cb-4102-9039-f636b385f413 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.435817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3c8e-e5cb-4102-9039-f636b385f413 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.436258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3c8e-e5cb-4102-9039-f636b385f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.466607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e4f3c8e-e5cb-4102-9039-f636b385f413 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:54.468081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e4f3c8e-e5cb-4102-9039-f636b385f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:54.548020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:54.567205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8334b1-34b2-4180-867e-6243056ad3aa None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.567792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8334b1-34b2-4180-867e-6243056ad3aa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.568309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8334b1-34b2-4180-867e-6243056ad3aa None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.569869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:28:54.575162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886730b9-0ddd-4d41-9cd7-d5b7375ffe0e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.575461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886730b9-0ddd-4d41-9cd7-d5b7375ffe0e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.575744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886730b9-0ddd-4d41-9cd7-d5b7375ffe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.582844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8334b1-34b2-4180-867e-6243056ad3aa None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:54.603622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-886730b9-0ddd-4d41-9cd7-d5b7375ffe0e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:54.604838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-886730b9-0ddd-4d41-9cd7-d5b7375ffe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:54.705724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:54.708340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26181-cb4b-418d-9dd1-5e07d266db59 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.709106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26181-cb4b-418d-9dd1-5e07d266db59 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.710852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26181-cb4b-418d-9dd1-5e07d266db59 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.712327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 14/26] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:54.718833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.719360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.719835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.737259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:54.750672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:54.752169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:54.772808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8334b1-34b2-4180-867e-6243056ad3aa None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:54.800241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:54.835534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:54.836212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:54.836500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:54.836780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:54.859424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:28:54.866604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:28:54.867451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:28:54.868197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:28:54.874417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 13/27] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:28:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:28:54.882893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:54.883142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:54.894138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.072420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76364511-63e8-459e-8072-7732dc43e12f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.074914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17c88d-71b5-44dc-b549-83097a12ee26 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.113379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.114128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.114322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.114597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.116139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:55.116449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.117873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.119571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:55.120075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.121692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.122220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.122672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.128146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 16/29] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:28:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:55.129285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.135471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.137388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.249802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3c9e-9eaa-4652-ad55-d4e62b767d70 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5ed1651c-0e54-492e-86cd-63f95377c9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:28:55.264233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:28:55.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:28:55.266015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:28:55.266015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:28:55.266015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:28:55.266015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:28:55.268102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 14/30] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:28:55.269584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa035-599f-4091-9a96-f4d5392b0005 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.270102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa035-599f-4091-9a96-f4d5392b0005 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.270574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa035-599f-4091-9a96-f4d5392b0005 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.272191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 15/31] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:55.273092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaa035-599f-4091-9a96-f4d5392b0005 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.288051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.288701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.288962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.289246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.290010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.291762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.307881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:55.387188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaa035-599f-4091-9a96-f4d5392b0005 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.427796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a559a-678d-407e-92d3-24ba1bd122cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.429261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a559a-678d-407e-92d3-24ba1bd122cd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.429819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a559a-678d-407e-92d3-24ba1bd122cd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.430341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a559a-678d-407e-92d3-24ba1bd122cd None admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.432086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a559a-678d-407e-92d3-24ba1bd122cd None admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.433791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a559a-678d-407e-92d3-24ba1bd122cd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.435711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 16/32] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:28:55 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:55.437106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa74b-aefe-4c0a-a9cb-bed9cae46ff7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.437631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa74b-aefe-4c0a-a9cb-bed9cae46ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.438154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa74b-aefe-4c0a-a9cb-bed9cae46ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.441871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 17/33] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 29 04:28:55 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:28:55.443078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.465768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8adfa74b-aefe-4c0a-a9cb-bed9cae46ff7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:55.467629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8adfa74b-aefe-4c0a-a9cb-bed9cae46ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:55.527394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:55.573374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 17/34] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:55.574841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707445-ac5f-42e3-8765-2669df698896 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.575133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707445-ac5f-42e3-8765-2669df698896 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.575415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707445-ac5f-42e3-8765-2669df698896 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.576751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 18/35] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:55.577554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707445-ac5f-42e3-8765-2669df698896 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.596414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2aa0-4356-45c8-89be-acf54954874c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.612849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:55.644766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.645757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.646593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.647145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.647852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:55.648331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.650557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7721bf-c681-472b-b9da-8ccad286df2a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.675471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 18/36] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:55.676847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.677143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.677468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.700130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:55.701735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:55.706472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707445-ac5f-42e3-8765-2669df698896 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.743323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.743961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.744244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.744515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.745714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.747163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.753283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 19/37] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:55.753283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.785629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:55.785629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:55.839265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:55.864438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:55.872146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7c074-370e-4d77-89cf-cc0d66b979cb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.893104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0c524-2342-4fad-b526-1a46396b5c61 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:55.905063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.905719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.906009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.906292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.907009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.908397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.928291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:55.928933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:55.929211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:55.929490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:55.930224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:55.931674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:55.960278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:28:55 2022] POST /identity/v3/projects => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:28:55.962599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:56.033332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 29 04:28:55 2022] POST /identity/v3/roles => generated 225 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:28:56.034528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:56.093227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:56.099786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d8a55-8caa-4966-bd98-88a2909dc796 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:56.155635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd730154-f762-41f3-9726-ae05b8cb1273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:56.156271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd730154-f762-41f3-9726-ae05b8cb1273 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:56.156564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd730154-f762-41f3-9726-ae05b8cb1273 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:56.156852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd730154-f762-41f3-9726-ae05b8cb1273 None admin] PATH_INFO: `/v3/domains/default/users/3b17a7a10c4d4b0096fc893a4bc53a62/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:56.159019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd730154-f762-41f3-9726-ae05b8cb1273 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3b17a7a10c4d4b0096fc893a4bc53a62, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:56.160528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd730154-f762-41f3-9726-ae05b8cb1273 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:56.182859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 21/41] 10.222.0.46 () {58 vars in 1361 bytes} [Fri Jul 29 04:28:55 2022] PUT /identity/v3/domains/default/users/3b17a7a10c4d4b0096fc893a4bc53a62/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:28:56.183457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e31c9-c2cb-4335-8e55-0a231c5bba73 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:56.184186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39f0e-4657-4957-8b12-5ff79764981f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:56.184480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39f0e-4657-4957-8b12-5ff79764981f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:56.184767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39f0e-4657-4957-8b12-5ff79764981f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:56.188882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 22/42] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:56.194997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:56.195341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:56.195635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:56.217775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:56.219019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:56.237986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:56.239574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:56.240372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:56.240885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:56.242121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:56.244493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:56.281341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 21/43] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 29 04:28:56 2022] POST /identity/v3/roles => generated 223 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:28:56.313995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 23/44] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:56.337488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:56.355987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:56.459505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114685-acf9-422a-9447-e84c6c68fbb7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:56.494840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb27c8-ef70-4a01-9497-125845cbd5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:56.495779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb27c8-ef70-4a01-9497-125845cbd5ab None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:56.496271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb27c8-ef70-4a01-9497-125845cbd5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:56.496745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb27c8-ef70-4a01-9497-125845cbd5ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:56.498223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb27c8-ef70-4a01-9497-125845cbd5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:56.499860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb27c8-ef70-4a01-9497-125845cbd5ab None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:56.501672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 22/45] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:56.507797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:56.595308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:56.610083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b49fa-15d9-4842-9b81-e2a5834c2f76 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:56.643585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e03c9-2521-4e88-bc5d-26b10ca7fad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:56.644209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e03c9-2521-4e88-bc5d-26b10ca7fad4 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:56.644497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e03c9-2521-4e88-bc5d-26b10ca7fad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:56.644779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e03c9-2521-4e88-bc5d-26b10ca7fad4 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:56.645461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e03c9-2521-4e88-bc5d-26b10ca7fad4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:56.646987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e03c9-2521-4e88-bc5d-26b10ca7fad4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:56.673487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:28:56 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:28:58.213948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f3ac-55b6-4633-bc4c-6bc0d5b8ce59 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.214432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f3ac-55b6-4633-bc4c-6bc0d5b8ce59 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.214432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f3ac-55b6-4633-bc4c-6bc0d5b8ce59 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.215782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:28:58.221060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.221476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.221665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.240615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:58.241820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:58.306361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:28:58.329103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12f3ac-55b6-4633-bc4c-6bc0d5b8ce59 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:58.412988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:58.436637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12f3ac-55b6-4633-bc4c-6bc0d5b8ce59 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:58.469832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:58.470408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.470696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.470977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.481239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:28:58.486275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:28:58.487256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:28:58.488080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 24/49] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:28:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:28:58.495295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:58.562309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:58.593559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2c56e-36d7-4ef3-b4eb-c6aa4db70497 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:58.626794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:58.627411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.627695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.627972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.628682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:58.628987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:58.631002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46303-faea-4012-8333-f7be729a21d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:58.638947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 26/50] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:28:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:28:58.644448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:58.664681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653f13-5771-41cd-9cbd-90d41f147e3f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.664968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653f13-5771-41cd-9cbd-90d41f147e3f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.665249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653f13-5771-41cd-9cbd-90d41f147e3f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.666855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 27/51] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:28:58.671564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.671846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.672130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.689995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:28:58.691534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:28:58.745280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a00b5-7a5c-4d75-996a-fef165384cbe None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:58.756510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 28/52] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:28:58.777304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:58.777969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.778254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.778531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.779685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:58.780692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:58.781140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:58.782759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 25/53] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:28:58 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:58.788570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:58.801098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:58.841610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:58.878630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caf57b-c53e-4780-9bf4-097c62781ba4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:58.887264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c838d68-6b27-40d5-87c7-9c2d7defc4fd None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:58.912430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:58.913071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.913356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.913663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.914807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:58.916512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:58.918144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 29/54] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:58.919765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:58.920397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:58.920680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:58.920955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:58.922131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:58.923578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:58.923718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:58.925631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 26/55] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:28:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:58.931178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:28:59.008588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:59.029762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064c50a-18cb-46c6-9e7c-66603ea52a7d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:59.033070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c564-dce5-43d1-aa40-3d5538ca9008 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:28:59.062871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:28:59.062997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:59.063516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:59.064277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:59.064277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:59.065036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.domain.id=default, user.id=3b17a7a10c4d4b0096fc893a4bc53a62) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:28:59.065347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:59.066809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d937ff-dc16-4164-a3a1-35f206b85f89 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:59.069032 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a89f-5e02-4bd3-8cff-ddedbb3915a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:28:59.069707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a89f-5e02-4bd3-8cff-ddedbb3915a3 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:28:59.069995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a89f-5e02-4bd3-8cff-ddedbb3915a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:28:59.070271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a89f-5e02-4bd3-8cff-ddedbb3915a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:28:59.070957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a89f-5e02-4bd3-8cff-ddedbb3915a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:28:59.072378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a89f-5e02-4bd3-8cff-ddedbb3915a3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:28:59.075453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 27/56] 10.222.0.46 () {56 vars in 1322 bytes} [Fri Jul 29 04:28:58 2022] GET /identity/v3/role_assignments?user.id=3b17a7a10c4d4b0096fc893a4bc53a62&scope.domain.id=default&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:28:59.099716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 30/57] 10.222.0.46 () {60 vars in 1140 bytes} [Fri Jul 29 04:28:58 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:29:01.115329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea5ee-03d6-4fa8-a80a-aea40ad6c190 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:01.115827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea5ee-03d6-4fa8-a80a-aea40ad6c190 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:01.115906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea5ee-03d6-4fa8-a80a-aea40ad6c190 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:01.117231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 28/58] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:01.122353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:01.122747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:01.122919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:01.141005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:01.142238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:01.208144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 31/59] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:01.233132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea5ee-03d6-4fa8-a80a-aea40ad6c190 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:01.331331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea5ee-03d6-4fa8-a80a-aea40ad6c190 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:01.363375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63406a-4f8c-46f7-84af-e72a64d1ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:01.364004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63406a-4f8c-46f7-84af-e72a64d1ebcc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:01.364293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63406a-4f8c-46f7-84af-e72a64d1ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:01.364633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63406a-4f8c-46f7-84af-e72a64d1ebcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:01.365827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63406a-4f8c-46f7-84af-e72a64d1ebcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:01.367288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63406a-4f8c-46f7-84af-e72a64d1ebcc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:01.368840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 29/60] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:01.374174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:01.470155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf8954-21c9-460c-a1c3-9e9ce1accbd5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:01.484060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:01.506536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0399ff6-cacb-431d-bf94-d21e6f8fe712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:01.507165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0399ff6-cacb-431d-bf94-d21e6f8fe712 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:01.507451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0399ff6-cacb-431d-bf94-d21e6f8fe712 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:01.507732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0399ff6-cacb-431d-bf94-d21e6f8fe712 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:01.508418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0399ff6-cacb-431d-bf94-d21e6f8fe712 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:01.509920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0399ff6-cacb-431d-bf94-d21e6f8fe712 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:01.536459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 32/61] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:01 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:04.573367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944588a-6b19-4119-ad4c-55ac9de8d434 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.573922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944588a-6b19-4119-ad4c-55ac9de8d434 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.574026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944588a-6b19-4119-ad4c-55ac9de8d434 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.575495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 30/62] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:04.581491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2e408-8bc9-484a-b348-674a8a2be772 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.582578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2e408-8bc9-484a-b348-674a8a2be772 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.583305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2e408-8bc9-484a-b348-674a8a2be772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.608380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eee2e408-8bc9-484a-b348-674a8a2be772 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:04.609946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eee2e408-8bc9-484a-b348-674a8a2be772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:04.691295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 33/63] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:04.726655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944588a-6b19-4119-ad4c-55ac9de8d434 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:04.749239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:04.791332 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d577a88-2c4c-43ba-b5fe-8de48ce88f0b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.791674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d577a88-2c4c-43ba-b5fe-8de48ce88f0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.791908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d577a88-2c4c-43ba-b5fe-8de48ce88f0b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.793410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 34/64] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:04.803787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f0c4-97ab-4e86-86ce-a87f883fdd28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.804086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f0c4-97ab-4e86-86ce-a87f883fdd28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.804373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f0c4-97ab-4e86-86ce-a87f883fdd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.833367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e90f0c4-97ab-4e86-86ce-a87f883fdd28 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:04.834488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e90f0c4-97ab-4e86-86ce-a87f883fdd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:04.853146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944588a-6b19-4119-ad4c-55ac9de8d434 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:04.888295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:04.889228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.889686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.890108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.901923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:04.907285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 35/65] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:04.907665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:04.908681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:04.909644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:04.912133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 31/66] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:04.913878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ab70-3c60-43e1-8e12-cca08ab5c507 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.914338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ab70-3c60-43e1-8e12-cca08ab5c507 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.914792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ab70-3c60-43e1-8e12-cca08ab5c507 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.916550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 36/67] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:04.923971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:04.933693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:04.935242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:04.935668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:04.962806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:04.964107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:04.990354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.008509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.039514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c328e9-8b40-46ce-9a00-95481556bb86 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.053718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 37/68] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:05.054765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.077250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.079673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.080916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.082139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.083227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:05.083630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.084985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.098686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 32/69] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:05.099851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.175115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fb129-2dbf-48cd-b904-517b38e46f3c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.204291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827c760-4b4d-409d-ab08-916e64208aa6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.210655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.211306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.211590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.211864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.222350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:05.228750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:05.230171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:05.230918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:05.234479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 38/70] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:05.235633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.239100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.245304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0cc62-3acc-4440-aa6f-81052289e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.245985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0cc62-3acc-4440-aa6f-81052289e349 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.246276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0cc62-3acc-4440-aa6f-81052289e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.246557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0cc62-3acc-4440-aa6f-81052289e349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.256843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.256960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0cc62-3acc-4440-aa6f-81052289e349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3ef0cc62-3acc-4440-aa6f-81052289e349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:05.261904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:05.262753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:05.263493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 33/71] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:05.264595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aba9a-1423-4a82-9346-9bb060f04b6b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.264595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aba9a-1423-4a82-9346-9bb060f04b6b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.264822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aba9a-1423-4a82-9346-9bb060f04b6b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.269808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 34/72] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:05.269808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aba9a-1423-4a82-9346-9bb060f04b6b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.352055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d8e9-6170-4eb2-8280-fedabbe977f1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.379080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aba9a-1423-4a82-9346-9bb060f04b6b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.388279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.388928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.389220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.389496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.404663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.406184 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.412747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 39/73] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:05.412747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.420741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.421371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.421687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.421969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.422709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:05.423023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.424424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25ad0e-b327-40ee-afaa-828c11009796 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.432477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 35/74] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:05.433655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.433951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.434228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.451252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:05.452767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:05.491388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.501163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.513712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f5c78-0081-48d2-887c-4175cebf42c8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.518217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 36/75] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:05.519020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.555394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.556018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.556302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.556824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.557287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:05.557645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.558994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81dafd-af06-4d55-88cd-7d0a9d3c9072 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.569507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 40/76] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:05.570697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f168f-4a5a-4e39-820f-a7b28c50d527 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.570989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f168f-4a5a-4e39-820f-a7b28c50d527 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.571271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f168f-4a5a-4e39-820f-a7b28c50d527 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.573642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 41/77] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:05.573642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f168f-4a5a-4e39-820f-a7b28c50d527 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.626629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3852-46e5-40ed-b7e2-67f40242b3f2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.661820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.662520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.662813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.663086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.674127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f168f-4a5a-4e39-820f-a7b28c50d527 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.706631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.707262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.707547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.707825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.709019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.710480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.712053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 42/78] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:05.712801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.714849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.721155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.732605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.734130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.809547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7358be4-9a03-4422-bfe2-55baa0d814fc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.830485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 37/79] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:05.831223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.844368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70582d-78e3-4b94-9088-aff70f2d6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.845014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70582d-78e3-4b94-9088-aff70f2d6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.845301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70582d-78e3-4b94-9088-aff70f2d6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.845587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70582d-78e3-4b94-9088-aff70f2d6a04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.856053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70582d-78e3-4b94-9088-aff70f2d6a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-dd70582d-78e3-4b94-9088-aff70f2d6a04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:05.861468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:05.862329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:05.863081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 43/80] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:05.863839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.864092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.864365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.881904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:05.883039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:05.916351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.934795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a66213-7527-409c-b988-43fa7d49296e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:05.945502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:05.955385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 44/81] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:05.956215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:05.978907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:05.979773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:05.980354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:05.980936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:05.982500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:05.984050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:05.987433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 38/82] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:05.988421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.072326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b59daf-5b14-4d58-be90-a8f7de1fd835 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.104630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.105151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811a23-932d-4431-b49a-269174b802a2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.105252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.105510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.105814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.138971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.139567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.139856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.140132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.141309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.142777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.144423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 39/83] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.145178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.167421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.170875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.179235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.180701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.244254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a7d0-7767-4062-bc24-3cd80fa18190 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.276483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 45/84] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:06.281311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.281311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.281527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.281625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.281625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.281625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:06.281625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.281625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.289657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 40/85] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.290443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.370135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.371344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.378067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234584e5-2a6b-4de7-826d-d7f8d8a8f9d2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.388590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2e940-53b7-4847-9fa9-9a6f2d644233 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.412935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.413502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.413827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.414111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.415241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.416925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.418561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 46/86] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.423358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.423465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.423465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.423684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.423968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.490986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.492987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.516077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39cffa-5c84-46db-9745-0e0525c34c53 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.549935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.550552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.550840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.551115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.551900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=9ebc69562ea14501b1b66e60c7ca23d4) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:06.552841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.554306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.559733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 47/87] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/role_assignments?user.id=9ebc69562ea14501b1b66e60c7ca23d4&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=696d13ce411c44db98ea6d86268618d9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.560524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.573488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.595367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 41/88] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:06.596113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.600871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.683853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc84d0f-5164-4e2b-ae8a-e51621331048 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.714045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105959-eeb2-4b15-9b31-f2511cec7471 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.720903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.721559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.721879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.722158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.723339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.725140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.726777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 48/89] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.727368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.750044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.750704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.750972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.751246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.752421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.753905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.755802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 42/90] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.760281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.807211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.836412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:06.843328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0774-a7f3-48d8-a124-e800b84ef1cf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.856102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ad33b-119d-42d7-8e43-8ec2110c4b98 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:06.878509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.879130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.879412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.879689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.880440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.881920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.895181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:06.896341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:06.896706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:06.897028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:06.898212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:06.899669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:06.906370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 43/91] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:06.906370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:06.906600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 49/92] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:06 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:06.906600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:07.029371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556e9ce-6294-42cc-97be-bf973bc13a88 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:07.034623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09002898-8fb7-4337-b4f1-23de1ae2ce55 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:07.064750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:07.076723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:07.077917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:07.078380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:07.078833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:07.089458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:07.090127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:07.090428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:07.090687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:07.091473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] RBAC: Adding query filter params (role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=9ebc69562ea14501b1b66e60c7ca23d4) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:07.091779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:07.093210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:07.104970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:07.105557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 44/93] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/role_assignments?user.id=9ebc69562ea14501b1b66e60c7ca23d4&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=95d5a16009d54ef398e385695bf7abcd => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:07.106727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:07.175086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:07.176857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:07.260302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62fc2-d6a9-477f-b0ef-2255c0dee371 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:07.299498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:07.300043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:07.300331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:07.300607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:07.301402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=3b17a7a10c4d4b0096fc893a4bc53a62) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:07.301750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:07.304330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:07.311448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 45/94] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:07 2022] GET /identity/v3/role_assignments?user.id=3b17a7a10c4d4b0096fc893a4bc53a62&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:07.314289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 50/95] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:07.323006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:07.378120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:07.440035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397f955-968f-4650-8d90-b08d009beb8f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:07.480710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e28c40-89f8-42df-a347-e0e450df7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:07.481474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e28c40-89f8-42df-a347-e0e450df7470 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:07.481859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e28c40-89f8-42df-a347-e0e450df7470 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:07.482224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e28c40-89f8-42df-a347-e0e450df7470 None admin] PATH_INFO: `/v3/projects/432790a0c401436fa3d258c97ca97108` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:07.483512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e28c40-89f8-42df-a347-e0e450df7470 None admin] RBAC: Authorizing `identity:get_project(project_id=432790a0c401436fa3d258c97ca97108)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:07.485063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e28c40-89f8-42df-a347-e0e450df7470 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:07.487051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 46/96] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:07 2022] GET /identity/v3/projects/432790a0c401436fa3d258c97ca97108 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:07.493765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:07.549620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:07.601900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373e55-ec9d-4da7-8dfa-5cee2312171a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:07.642605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:07.643381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:07.643830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:07.644185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:07.645058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=432790a0c401436fa3d258c97ca97108, user.id=9ebc69562ea14501b1b66e60c7ca23d4) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:07.645448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:07.647545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7da4ef-7014-436a-bb44-f7855887a5e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:07.656173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 51/97] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:07 2022] GET /identity/v3/role_assignments?user.id=9ebc69562ea14501b1b66e60c7ca23d4&scope.project.id=432790a0c401436fa3d258c97ca97108&role.id=696d13ce411c44db98ea6d86268618d9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:09.521979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159794e-4a4b-4824-a4bf-9e8ba8014e36 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:09.522529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159794e-4a4b-4824-a4bf-9e8ba8014e36 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:09.522807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159794e-4a4b-4824-a4bf-9e8ba8014e36 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:09.524573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 47/98] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:09.529463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b92511-6f36-47ad-9226-abd47658e419 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:09.529886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b92511-6f36-47ad-9226-abd47658e419 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:09.530252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b92511-6f36-47ad-9226-abd47658e419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:09.552391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8b92511-6f36-47ad-9226-abd47658e419 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:09.553677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8b92511-6f36-47ad-9226-abd47658e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:09.633995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 52/99] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:09.667204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159794e-4a4b-4824-a4bf-9e8ba8014e36 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:09.792629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159794e-4a4b-4824-a4bf-9e8ba8014e36 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:09.814426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:09.835178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c354-5e71-4a00-8fc7-5b300e61c1ff None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:09.835489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c354-5e71-4a00-8fc7-5b300e61c1ff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:09.835790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c354-5e71-4a00-8fc7-5b300e61c1ff None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:09.840659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 53/100] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:09.842241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9432a2f-82df-41f2-a1f4-9ea52b5c6350 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:09.842553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9432a2f-82df-41f2-a1f4-9ea52b5c6350 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:09.842840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9432a2f-82df-41f2-a1f4-9ea52b5c6350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:09.842939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:09.843510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:09.843794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:09.844072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:09.860818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:09.867438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:09.868292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:09.869040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:09.871526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 48/101] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:09.877186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c9432a2f-82df-41f2-a1f4-9ea52b5c6350 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:09.877501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:09.878440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c9432a2f-82df-41f2-a1f4-9ea52b5c6350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:10.023721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.034459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bf4d1-0435-42b7-8980-499cdbc97177 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.080409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 54/102] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:10.082012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b569d-2d69-44c5-9751-77dd3d3cf2a1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.082521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b569d-2d69-44c5-9751-77dd3d3cf2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.084577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b569d-2d69-44c5-9751-77dd3d3cf2a1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.086090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 55/103] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:10.091431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.091941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.092431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.110295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.111242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.114101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.114667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.115599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:10.116134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:10.117781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:10.130849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:10.133759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:10.135790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 49/104] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:10.138818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.221316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.249439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 56/105] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:10.253735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.344598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa719a01-9ea5-4e7e-a58f-192b94306ce9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.373506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54bca9-7a29-4d12-94ad-dd6cea67979a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.381167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.381897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.382705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.383451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.383955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.398996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:10.407298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:10.408312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:10.409272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:10.412083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 50/106] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:10.413174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.415450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7021-7cfe-4e87-9072-70eb5f13008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.416470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7021-7cfe-4e87-9072-70eb5f13008d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.417039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7021-7cfe-4e87-9072-70eb5f13008d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.417389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7021-7cfe-4e87-9072-70eb5f13008d None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.419512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e7021-7cfe-4e87-9072-70eb5f13008d None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:10.421095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e7021-7cfe-4e87-9072-70eb5f13008d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:10.422861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 57/107] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:10.425904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9e76e-8c8b-4143-a350-9ac940c24fe6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.426339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9e76e-8c8b-4143-a350-9ac940c24fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.426751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9e76e-8c8b-4143-a350-9ac940c24fe6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.428791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 58/108] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:10.432753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9e76e-8c8b-4143-a350-9ac940c24fe6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.535564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.544455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0313-05cc-44a7-8b3d-3a018da14727 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.549227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9e76e-8c8b-4143-a350-9ac940c24fe6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.579654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906e52e-eb17-4ba9-9eda-10f1aecda26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.580654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906e52e-eb17-4ba9-9eda-10f1aecda26e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.581001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906e52e-eb17-4ba9-9eda-10f1aecda26e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.581281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906e52e-eb17-4ba9-9eda-10f1aecda26e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.587111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.587729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.588012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.588286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.588994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:10.589300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:10.590777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:10.594970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906e52e-eb17-4ba9-9eda-10f1aecda26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:10.600196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 59/109] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6906e52e-eb17-4ba9-9eda-10f1aecda26e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:10.603953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:10.604811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:10.605546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:10.606175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.606243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 51/110] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:10.607035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596ab4-5249-4e4d-9f64-1317a07fce1e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.607331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596ab4-5249-4e4d-9f64-1317a07fce1e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.607614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596ab4-5249-4e4d-9f64-1317a07fce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.625550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-59596ab4-5249-4e4d-9f64-1317a07fce1e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:10.626809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-59596ab4-5249-4e4d-9f64-1317a07fce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:10.640367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.693713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 52/111] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:10.705673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfc302-4d68-44d2-b433-fa6f7e4c780b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.705673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfc302-4d68-44d2-b433-fa6f7e4c780b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.705673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfc302-4d68-44d2-b433-fa6f7e4c780b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.705673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 53/112] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:10.705673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488cabf-4daa-4df0-be78-67f2f152399c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.705673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488cabf-4daa-4df0-be78-67f2f152399c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.709381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488cabf-4daa-4df0-be78-67f2f152399c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.709381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 54/113] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:10.709381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488cabf-4daa-4df0-be78-67f2f152399c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.709562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91491-2b48-4502-b534-9cadc56f7b34 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.742419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.743219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.743512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.743794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.744975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:10.746460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:10.748127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 60/114] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:10.748886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.792379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.809084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488cabf-4daa-4df0-be78-67f2f152399c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.842863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329634d-5703-45cf-a65e-e04eb7c57692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.843528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329634d-5703-45cf-a65e-e04eb7c57692 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.843813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329634d-5703-45cf-a65e-e04eb7c57692 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.844090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329634d-5703-45cf-a65e-e04eb7c57692 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.845317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329634d-5703-45cf-a65e-e04eb7c57692 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:10.846231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819821-6e41-4fef-9068-c04d61d71948 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:10.846759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329634d-5703-45cf-a65e-e04eb7c57692 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:10.848355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 55/115] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:10.848613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:10.850211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.850573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.850914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.869630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:10.871307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:10.889719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:10.890812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.891349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.891874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.893088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:10.893408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:10.894847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e99781-e69a-4683-ab3a-84b9724ea273 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:10.903801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 61/116] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:10.905018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:10.905375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:10.905631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:10.923229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:10.924436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:10.950497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 56/117] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:10.951350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:10.998195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 62/118] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:10.999016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.051222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.066840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7df4d8-88fd-4301-8007-86d091e3c7ad None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.090833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.097428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1068a-b4fb-46b4-b3af-c2218d82e691 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.101244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.101940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.102224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.102500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.103650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.105101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.106713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 57/119] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:11.106713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.138897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.139564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.139845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.140125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/9ebc69562ea14501b1b66e60c7ca23d4/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.142080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=404edea2367442d9aae1754fdc0c7db5, user_id=9ebc69562ea14501b1b66e60c7ca23d4, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.143531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.156337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 63/120] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:10 2022] PUT /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/9ebc69562ea14501b1b66e60c7ca23d4/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:11.157231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.214490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d69658-e2ff-4c3f-a587-6b9ebcf6ef0c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.265862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.266683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.267327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.267644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.272173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.273725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.276380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 58/121] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:11.276380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.287761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369ae8a-e900-463b-bcd6-f5d748f974c0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.307572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.330795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.331444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.331731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.332010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] PATH_INFO: `/v3/users/6c374ad2a8a64c7481153bb260bd7bef` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.346608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] RBAC: Authorizing `identity:get_user(user_id=6c374ad2a8a64c7481153bb260bd7bef)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.348147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.354839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 64/122] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/users/6c374ad2a8a64c7481153bb260bd7bef => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:11.354839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.366959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.403979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e63b3f-72c5-4a63-b307-f3bd410ce084 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.440394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.441035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.441323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.441623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.452811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:11.455226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f236919-68d4-4fbe-81a7-0f13717ceeba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:11.457892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:11.459265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:11.460047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 59/123] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:11.460661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.496717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.497362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.497667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.497944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.508915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:11.514358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:11.515231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 65/124] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:11.516757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.548300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.570700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e349a1-1b28-4626-bc86-fee1a4a2d357 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.603633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.609061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.609719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.610008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.610287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.610979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.612438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.633720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da4a9-bf17-43f0-97bd-fa44aa593483 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.643915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 60/125] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:29:11 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:11.655241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.682879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.683582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.683871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.684209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/9ebc69562ea14501b1b66e60c7ca23d4/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.687318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=404edea2367442d9aae1754fdc0c7db5, user_id=9ebc69562ea14501b1b66e60c7ca23d4, role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.689114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.709004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 66/126] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:11 2022] PUT /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/9ebc69562ea14501b1b66e60c7ca23d4/roles/95d5a16009d54ef398e385695bf7abcd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:11.714704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.848465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdf7ea-21cc-4604-a20e-702ecd75872a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.854106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c1b9-c567-4145-8905-db13055e29f8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:11.887524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.895326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.897400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.898110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.898441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.899255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:11.900136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:11.900645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:11.901133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:11.902127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:11.902656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.904288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:11.914005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 67/127] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:11.915206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:11.916417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:11.997329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:11.999208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.040890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c96cb2-c17f-46ea-aeb0-581646ca3304 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.084375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.085626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.085913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.086484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.087211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:12.087779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.090077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.100504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 68/128] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.101328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.129775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 61/129] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:12.130730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.174414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:12.179252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:12.224564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9838f8-c013-42a0-b845-661f8b0722da None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.247155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ac25-9d1a-4560-a090-e5b22aab38be None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.261186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.262117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.262549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.262985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.264333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.265986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.272890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 69/130] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:12 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.274023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.283916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.284581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.284867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.285270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.286452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.287914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.289523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 62/131] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:12 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.290309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.388777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914bf7-37cb-4357-ac3a-67744f79c9ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.422726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:12.426306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1fb4f-8cd6-4104-81ad-f92b31b0a385 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.441982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:12.451769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.452435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.454167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.454464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.458915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.460403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.462185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 70/132] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:12 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.467068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.495240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.495899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.496188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.496469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.498418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.502604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.504296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 63/133] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:12 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.506635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.663773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30b09-ba89-47fe-a626-c5f32e75639b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.666919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc462fd-37a1-4c6a-8f7f-6cadb2caac9f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.705234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.706298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.706805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.707599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.709238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] RBAC: Adding query filter params (role.id=b587cc9cc7964082838e9c4e2f1ee480, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=6c374ad2a8a64c7481153bb260bd7bef) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:12.710168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.711855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.718360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 64/134] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:12 2022] GET /identity/v3/role_assignments?user.id=6c374ad2a8a64c7481153bb260bd7bef&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=b587cc9cc7964082838e9c4e2f1ee480 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.719632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.777217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:12.778431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.779127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.779445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.779725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] PATH_INFO: `/v3/projects/432790a0c401436fa3d258c97ca97108` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.781059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] RBAC: Authorizing `identity:get_project(project_id=432790a0c401436fa3d258c97ca97108)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.782599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.784385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 71/135] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:12 2022] GET /identity/v3/projects/432790a0c401436fa3d258c97ca97108 => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:12.790370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:12.903989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196d2eb-002e-4689-8df2-5d62d6cf481f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:12.948429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:12.980979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a504-c55f-4605-8b07-5f180bae65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:12.982079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a504-c55f-4605-8b07-5f180bae65f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:12.982594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a504-c55f-4605-8b07-5f180bae65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:12.983080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a504-c55f-4605-8b07-5f180bae65f5 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/3b17a7a10c4d4b0096fc893a4bc53a62/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:12.985440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a504-c55f-4605-8b07-5f180bae65f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=404edea2367442d9aae1754fdc0c7db5, user_id=3b17a7a10c4d4b0096fc893a4bc53a62, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:12.991499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a504-c55f-4605-8b07-5f180bae65f5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:12.996661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe1f7-0cef-4d87-89a5-3a0646cd0799 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:13.018923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 65/136] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:12 2022] PUT /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/3b17a7a10c4d4b0096fc893a4bc53a62/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:13.036510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c96a-86b6-4a26-b685-d76a5ffe8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:13.037204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c96a-86b6-4a26-b685-d76a5ffe8e50 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:13.037492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c96a-86b6-4a26-b685-d76a5ffe8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:13.037809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c96a-86b6-4a26-b685-d76a5ffe8e50 None admin] PATH_INFO: `/v3/projects/432790a0c401436fa3d258c97ca97108/users/9ebc69562ea14501b1b66e60c7ca23d4/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:13.039822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111c96a-86b6-4a26-b685-d76a5ffe8e50 None admin] RBAC: Authorizing `identity:create_grant(project_id=432790a0c401436fa3d258c97ca97108, user_id=9ebc69562ea14501b1b66e60c7ca23d4, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:13.041618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111c96a-86b6-4a26-b685-d76a5ffe8e50 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:13.058411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 72/137] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:12 2022] PUT /identity/v3/projects/432790a0c401436fa3d258c97ca97108/users/9ebc69562ea14501b1b66e60c7ca23d4/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:13.542145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03adcb-7c13-4bb2-b5a1-eaba7730d29d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:13.542719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03adcb-7c13-4bb2-b5a1-eaba7730d29d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:13.543151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03adcb-7c13-4bb2-b5a1-eaba7730d29d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:13.545058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 66/138] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:13.550417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:13.550892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:13.551324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:13.578582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:13.580078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:13.665020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 73/139] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:13.704138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03adcb-7c13-4bb2-b5a1-eaba7730d29d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:13.824455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:13.839211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03adcb-7c13-4bb2-b5a1-eaba7730d29d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:13.882486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:13.883166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:13.883458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:13.883746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:13.898059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:13.903544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:13.904415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:13.905237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 67/140] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:13.912186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:13.999015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:14.051485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fd1d0-4f89-4f0c-b998-fd22468b5ee2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:14.087352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:14.088300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:14.088797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:14.089277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:14.090220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:14.090737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:14.092370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:14.101529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 74/141] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:14.107313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:14.237922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa30f7-719c-4558-9889-ea3ebd3c7e45 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:14.277548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:14.278572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:14.279089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:14.279573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:14.280964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:14.282654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:14.284474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 68/142] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:14 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:14.290235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:14.409696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac4bc-fb97-4850-84ad-89eca5eabcc6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:14.430693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:14.454781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb06c8-b111-45dd-a25a-515f9eddd63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:14.455758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb06c8-b111-45dd-a25a-515f9eddd63b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:14.456242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb06c8-b111-45dd-a25a-515f9eddd63b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:14.456730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb06c8-b111-45dd-a25a-515f9eddd63b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:14.541783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb06c8-b111-45dd-a25a-515f9eddd63b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:14.543588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb06c8-b111-45dd-a25a-515f9eddd63b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:14.672645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 75/143] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:14.679474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:14.704222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:14.796461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635365c-23b5-4578-89e0-6faaa3072916 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:14.796774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635365c-23b5-4578-89e0-6faaa3072916 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:14.797026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635365c-23b5-4578-89e0-6faaa3072916 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:14.798436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 76/144] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:14.805402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18743a-4160-4387-b375-1c001258bf38 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:14.808089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:14.808376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:14.808653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:14.838216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:14.839427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:14.859755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:14.881742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:14.882408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:14.882694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:14.882974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:14.886498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:14.887969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:14.890957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 69/145] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:14 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:14.898504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:14.990107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 77/146] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:15.020567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:15.032493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:15.046360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79f795-7938-44a0-a819-1a8d14a9c99b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.082866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.083551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.083847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.084129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.084898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=9ebc69562ea14501b1b66e60c7ca23d4) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:15.085242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:15.086690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6565e-1e1b-4a3c-97af-55c95fdae4df None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:15.092598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 70/147] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:14 2022] GET /identity/v3/role_assignments?user.id=9ebc69562ea14501b1b66e60c7ca23d4&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=696d13ce411c44db98ea6d86268618d9 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:15.136590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99caa-beef-49b5-a18c-e665a4e200f5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.158238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d4b7-7cbf-4563-b18d-20c8cc06d9a5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.158571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d4b7-7cbf-4563-b18d-20c8cc06d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.158759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652d4b7-7cbf-4563-b18d-20c8cc06d9a5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.160384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 71/148] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:29:15.182391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.182675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.182960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.203007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.203682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.203967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.204241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.210354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:15.211617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:15.231857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:15.236958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:15.237864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:15.239060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 78/149] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:15.243992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:15.257957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:15.331642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 72/150] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:15.400926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:15.502170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175538f-c31b-45ba-b6dd-4240e35c2766 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.561159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.561866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.562153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.562431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.563581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:15.564029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:15.565428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:15.574711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 79/151] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:15.579554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:15.581075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:15.625362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da406a4-8718-4604-bb32-dc318fd5e0f1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.655648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:15.686312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.686979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.687263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.687533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.688715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:15.690189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:15.691776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 73/152] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:15.696429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7626-9ceb-4b12-ae74-3735cdf58caf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.714646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:15.736074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.736824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.737112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.737392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.738665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:15.740755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:15.742760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 80/153] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:15 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:15.748820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:15.855170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42e8b7-a352-4171-8044-19b19e40f342 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.890920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cfd91-af8b-4e01-9172-0eb2add62684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.891542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cfd91-af8b-4e01-9172-0eb2add62684 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.891828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cfd91-af8b-4e01-9172-0eb2add62684 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:15.892110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cfd91-af8b-4e01-9172-0eb2add62684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:15.901970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:15.961144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabb2c4-fb30-4ba9-ad2d-a4bb49f3fc24 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:15.965616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cfd91-af8b-4e01-9172-0eb2add62684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:15.967118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cfd91-af8b-4e01-9172-0eb2add62684 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:15.999010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c6ce1-9b06-4c07-99ce-22fd743ae2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:15.999635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c6ce1-9b06-4c07-99ce-22fd743ae2f6 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:15.999939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c6ce1-9b06-4c07-99ce-22fd743ae2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.000196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c6ce1-9b06-4c07-99ce-22fd743ae2f6 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.000882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c6ce1-9b06-4c07-99ce-22fd743ae2f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:16.002356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c6ce1-9b06-4c07-99ce-22fd743ae2f6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 74/154] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:15 2022] POST /identity/v3/users => generated 283 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd757-0e90-4696-a661-332edb9d6c0e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd757-0e90-4696-a661-332edb9d6c0e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd757-0e90-4696-a661-332edb9d6c0e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 75/155] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d600-d34a-42e0-980f-6995f4d6a905 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.037622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d600-d34a-42e0-980f-6995f4d6a905 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.038159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d600-d34a-42e0-980f-6995f4d6a905 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.038584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 76/156] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:16.045360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc60c-d3bc-4c21-bf42-20f26fa70dd1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.045727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc60c-d3bc-4c21-bf42-20f26fa70dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.046004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc60c-d3bc-4c21-bf42-20f26fa70dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.069543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:16.080888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c52dc60c-d3bc-4c21-bf42-20f26fa70dd1 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:16.082810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c52dc60c-d3bc-4c21-bf42-20f26fa70dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:16.106786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 81/157] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 04:29:16.106786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168bf1-0be0-494c-8044-3fe20d1d2dd7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.106786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168bf1-0be0-494c-8044-3fe20d1d2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.106786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168bf1-0be0-494c-8044-3fe20d1d2dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.126040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b0168bf1-0be0-494c-8044-3fe20d1d2dd7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:16.127621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b0168bf1-0be0-494c-8044-3fe20d1d2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:16.157481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:16.180140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 77/158] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:16.180140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a4a0-7db1-45f7-b784-4fcd7cebf889 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.180140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a4a0-7db1-45f7-b784-4fcd7cebf889 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.180140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a4a0-7db1-45f7-b784-4fcd7cebf889 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.180140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 78/159] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:16.180140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a4a0-7db1-45f7-b784-4fcd7cebf889 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.221890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 82/160] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:16.223105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.223395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.224203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.246747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:16.248062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:16.305366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a4a0-7db1-45f7-b784-4fcd7cebf889 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:16.344785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:16.345444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.346585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.346869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.347213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 83/161] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:16.348064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.349320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:16.351106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:16.353231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 79/162] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:16.354217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.359207 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:16.470412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:16.477752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233f005-e5bb-4945-ad20-c40110be9c97 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:16.498388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317e51b-e881-444e-a3ac-2a32bc9c32d0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:16.517692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:16.518342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.518622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.518891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.533081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:16.538169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:16.539013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:16.539864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 84/163] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:16.540518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.544822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:16.545483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.545820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.546153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.559059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:16.564157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:16.565043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:16.565819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 80/164] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:16.566457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.664258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:16.678553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572a1fc-b3fb-4a5d-8c2e-85fd4d24c8c1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:16.731629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79a1b-142f-4672-b5d9-26a00721e964 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:16.744339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:16.744973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.745258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.745536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.746351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] RBAC: Adding query filter params (role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=9ebc69562ea14501b1b66e60c7ca23d4) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:16.746665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:16.748132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:16.754994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 85/165] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/role_assignments?user.id=9ebc69562ea14501b1b66e60c7ca23d4&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=95d5a16009d54ef398e385695bf7abcd => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:16.755829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.777560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:16.840083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:16.840767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.841054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.841335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.852731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:16.857756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:16.858592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:16.859372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 81/166] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:16.865187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:16.869276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dfe3f-18ab-43e3-8237-12321eb45baa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:16.907030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:16.907665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:16.907946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:16.908222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:16.908951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:16.909248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:16.910683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:16.921300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 86/167] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:16.922141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.012837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:17.034900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960627e7-f468-494d-96ad-e44c71a35c6d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.071409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.072044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.072333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.072614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.073337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:17.073708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.075060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.084387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e387d-774a-4884-8f83-6bf9faea7ef1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.084743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 87/168] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:17.085584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.114029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:17.146726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.147368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.147653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.147930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.148660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:17.148969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.150517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.168262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 82/169] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:17.169114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.196050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8145-5624-4d6e-88b8-24fc1ccda189 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.230904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.231559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.231843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.232123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] PATH_INFO: `/v3/users/6c374ad2a8a64c7481153bb260bd7bef` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.233319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] RBAC: Authorizing `identity:get_user(user_id=6c374ad2a8a64c7481153bb260bd7bef)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.234799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.236415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 88/170] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:17 2022] GET /identity/v3/users/6c374ad2a8a64c7481153bb260bd7bef => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:17.237180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.250482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:17.344626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10243ab-0416-4095-a57a-8889f10abcac None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.382551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.383395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ee26-3a0d-4621-914b-122cd9619673 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.383692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.384116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.384534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] PATH_INFO: `/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.385910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] RBAC: Authorizing `identity:get_user(user_id=3b17a7a10c4d4b0096fc893a4bc53a62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.387498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.389273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 89/171] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:17 2022] GET /identity/v3/users/3b17a7a10c4d4b0096fc893a4bc53a62 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:17.390224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.468400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.468985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.469273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.469554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] PATH_INFO: `/v3/users/9ebc69562ea14501b1b66e60c7ca23d4` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.471045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebc69562ea14501b1b66e60c7ca23d4)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.472293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.472796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:17.474713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 83/172] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:17 2022] GET /identity/v3/users/9ebc69562ea14501b1b66e60c7ca23d4 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:17.475322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.496875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aade0-2721-45f2-9895-3409e7f984e6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.532318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.533255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.533711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.534153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.535584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.537854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.539800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 90/173] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:17 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:17.540777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:17.612501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:17.646967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc6052-9cc3-4dc3-9f59-91f093e03bba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.683214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.684069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.684496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.684943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.701693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:17.717693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fcbf-1941-40c4-822a-f204e6177803 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:17.770254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.771837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.793963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:17.794592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:17.794876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:17.795148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:17.901164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:17.902975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:17.963155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:18.001518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 91/174] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:18.006307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:18.020477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 84/175] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:18.021170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:18.110118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:18.212630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db98dc-e4dc-4b66-8a60-da021fe92f3e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:18.216079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f355-350b-42ec-bb61-2731e3c103b5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:18.269132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51188e92-f964-4777-9918-129cafa4acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:18.269833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51188e92-f964-4777-9918-129cafa4acda None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.270111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51188e92-f964-4777-9918-129cafa4acda None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.270412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51188e92-f964-4777-9918-129cafa4acda None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/6c374ad2a8a64c7481153bb260bd7bef/roles/b587cc9cc7964082838e9c4e2f1ee480` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.272417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51188e92-f964-4777-9918-129cafa4acda None admin] RBAC: Authorizing `identity:create_grant(project_id=404edea2367442d9aae1754fdc0c7db5, user_id=6c374ad2a8a64c7481153bb260bd7bef, role_id=b587cc9cc7964082838e9c4e2f1ee480)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:18.273838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51188e92-f964-4777-9918-129cafa4acda None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:18.290353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 92/176] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:18 2022] PUT /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5/users/6c374ad2a8a64c7481153bb260bd7bef/roles/b587cc9cc7964082838e9c4e2f1ee480 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:18.291525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51188e92-f964-4777-9918-129cafa4acda None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:18.306966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:18.307640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.307929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.308209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] PATH_INFO: `/v3/projects/432790a0c401436fa3d258c97ca97108` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.309415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=432790a0c401436fa3d258c97ca97108)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:18.310923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:18.312599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 85/177] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:18 2022] GET /identity/v3/projects/432790a0c401436fa3d258c97ca97108 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:18.322652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:18.391390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:18.409950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51188e92-f964-4777-9918-129cafa4acda None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:18.429992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:18.460145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:18.460813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.461136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.461414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.464211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:18.465720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:18.467611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 93/178] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:18 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:18.473457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:18.575909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749934f-3e89-4077-85f5-1dc3d03b7cd2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:18.620089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:18.621118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.621409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.621720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.623082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=432790a0c401436fa3d258c97ca97108, user.id=9ebc69562ea14501b1b66e60c7ca23d4) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:18.623697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:18.625166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0190f-77a1-42c6-9067-23c94dac1073 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:18.633493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 86/179] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:18 2022] GET /identity/v3/role_assignments?user.id=9ebc69562ea14501b1b66e60c7ca23d4&scope.project.id=432790a0c401436fa3d258c97ca97108&role.id=696d13ce411c44db98ea6d86268618d9 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:18.634933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7843-8df3-4b5e-9264-74e07066b42c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.635227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7843-8df3-4b5e-9264-74e07066b42c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.635608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7843-8df3-4b5e-9264-74e07066b42c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.636957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 87/180] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:18.643102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.643430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.643793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.653961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f32d1-b40d-4ccb-a453-860591885e80 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:18.666511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:18.668138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:18.698673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:18.699336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.699675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.699953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.700800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=3b17a7a10c4d4b0096fc893a4bc53a62) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:18.701283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:18.702894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:18.714342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 94/181] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:18 2022] GET /identity/v3/role_assignments?user.id=3b17a7a10c4d4b0096fc893a4bc53a62&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:18.756835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 88/182] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:18.780721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:18.830893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:18.909859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d46a-f67f-4fea-a96e-2be773fdac02 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:18.970513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55ae7f-2710-4b79-800c-011862af826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:18.971170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55ae7f-2710-4b79-800c-011862af826e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:18.971452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55ae7f-2710-4b79-800c-011862af826e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:18.971725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55ae7f-2710-4b79-800c-011862af826e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:18.992432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55ae7f-2710-4b79-800c-011862af826e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3b55ae7f-2710-4b79-800c-011862af826e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:18.998051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:18.998949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:19.000369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 95/183] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:19.005385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.015385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69449-c060-4497-833a-2088dc654017 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.015691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69449-c060-4497-833a-2088dc654017 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.015925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69449-c060-4497-833a-2088dc654017 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.017274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 96/184] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:19.028490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.028490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.028490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.033669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.061788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:19.063361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:19.152481 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264fd65-9c23-4dc1-b213-ad29c5dd8e20 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.177491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 97/185] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:19.206085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.210969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.212090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.212090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.212255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.212888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:19.213200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:19.214623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:19.228643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 89/186] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:19.235018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.249426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.338398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.363803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87eec6-df60-4a8a-9523-a4035aaa2c50 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.364718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e54e8-6ce9-49ba-befd-94a9ae4013c0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.401262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896239f4-4fc1-4a53-af2f-350b33bffd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.402035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896239f4-4fc1-4a53-af2f-350b33bffd2e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.402438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896239f4-4fc1-4a53-af2f-350b33bffd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.402841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896239f4-4fc1-4a53-af2f-350b33bffd2e None admin] PATH_INFO: `/v3/users/c4fabf96c7814842814f88311784bcc5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.417466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35762e-3680-4963-b99a-73b44addb23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.418156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35762e-3680-4963-b99a-73b44addb23f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.418443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35762e-3680-4963-b99a-73b44addb23f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.418720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35762e-3680-4963-b99a-73b44addb23f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.420839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896239f4-4fc1-4a53-af2f-350b33bffd2e None admin] RBAC: Authorizing `identity:get_user(user_id=c4fabf96c7814842814f88311784bcc5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:19.422530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896239f4-4fc1-4a53-af2f-350b33bffd2e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:19.425737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 90/187] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/users/c4fabf96c7814842814f88311784bcc5 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:19.427516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f97e-6288-4720-9b13-8c69a06ae225 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.428026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f97e-6288-4720-9b13-8c69a06ae225 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.428398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f97e-6288-4720-9b13-8c69a06ae225 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.429643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 91/188] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:19.434389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f97e-6288-4720-9b13-8c69a06ae225 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.437705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35762e-3680-4963-b99a-73b44addb23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3f35762e-3680-4963-b99a-73b44addb23f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:19.443244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:19.451030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 98/189] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:19.453512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.454246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.454246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.467439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:19.468639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:19.541778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 99/190] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:19.541778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.562393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f97e-6288-4720-9b13-8c69a06ae225 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.563326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.601893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.602645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.603245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.603351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.608495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.650950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f4bab-dee2-4846-9ace-3d56eacf5eb5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.680973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:19.682404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:19.688850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.689472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.689785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.690322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.690773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:19.691072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:19.692475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:19.701191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 100/191] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:19.706197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.803200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.820454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 92/192] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:19.821617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.828269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868cec5-9d81-453d-9826-d66972484d8d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.857543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:19.866535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.867175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.867456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.867729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.868865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:19.870336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:19.871903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 101/193] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:19.876446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.933754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898f46-822d-4bb8-9e45-51cfdcb9b703 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:19.970025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:19.970666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:19.970950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:19.971227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] PATH_INFO: `/v3/users/c4fabf96c7814842814f88311784bcc5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:19.972400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=c4fabf96c7814842814f88311784bcc5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:19.973948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:19.975731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 93/194] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/users/c4fabf96c7814842814f88311784bcc5 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:19.976269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:19.989327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a492b8-cbb0-46e4-9595-7496d073946c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:20.025911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:20.026710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.026998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.027278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.028439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:20.029926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:20.031750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 102/195] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:19 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:20.032329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:20.050621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:20.084458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017519-5d70-4f1d-ab6e-70eec3615bd1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:20.088413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:20.129589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:20.130300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.130722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.131135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.132033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:20.133476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:20.156798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 94/196] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:19 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:20.158073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:20.164672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c4ca5-de25-4942-b6b1-5e7b9dc12bfb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:20.208916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:20.209507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.209827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.210108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.296513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:20.298689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:20.307579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f8b3-2a60-4cc8-a347-93d7a6416b87 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:20.319179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:20.351774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:20.352407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.352689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.352961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.353795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=c4fabf96c7814842814f88311784bcc5) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:20.354097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:20.355543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:20.361296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 95/197] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:20 2022] GET /identity/v3/role_assignments?user.id=c4fabf96c7814842814f88311784bcc5&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:20.425109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 103/198] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:20.431082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:20.467394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:20.565293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b24-077b-40c1-bea0-bfc294aed695 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:20.603853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc958637-dac3-4a32-91fe-092dda610898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:20.604783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958637-dac3-4a32-91fe-092dda610898 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.605215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958637-dac3-4a32-91fe-092dda610898 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.605684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958637-dac3-4a32-91fe-092dda610898 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.607852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc958637-dac3-4a32-91fe-092dda610898 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:20.609547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc958637-dac3-4a32-91fe-092dda610898 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:20.612091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 96/199] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:20 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:20.618254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:20.711819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dd20-57d4-4f00-9c7a-c3d5daf888bd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.712369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dd20-57d4-4f00-9c7a-c3d5daf888bd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.712796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dd20-57d4-4f00-9c7a-c3d5daf888bd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.714616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 97/200] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:29:20.723028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.723599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.724088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.741668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac018-36cd-45ec-8eab-42e6fb966838 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:20.755795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:20.758506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:20.776929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:20.809063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:20.809710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:20.809993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:20.810266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:20.811082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] RBAC: Adding query filter params (role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=c4fabf96c7814842814f88311784bcc5) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:20.811371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:20.812834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:20.824343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 104/201] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:20 2022] GET /identity/v3/role_assignments?user.id=c4fabf96c7814842814f88311784bcc5&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=95d5a16009d54ef398e385695bf7abcd => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:20.884474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 98/202] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:20.919805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:21.061911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b16c1-d792-4c90-a92f-d97eace0ae3e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:21.106770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:21.107482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:21.107832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:21.108158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:21.119995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:21.126251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:21.127115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:21.127900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 105/203] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:21.135596 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:21.159986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:21.257212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f2cf-41ea-46c7-ba81-0311a937cb62 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:21.293565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:21.294216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:21.294503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:21.294779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:21.295504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:21.295811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:21.297206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:21.305760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 99/204] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:21.311382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:21.355287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:21.436082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab605-aa8b-453b-b9b7-becbd32e788c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:21.476558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:21.477439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:21.477884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:21.478299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] PATH_INFO: `/v3/users/6c374ad2a8a64c7481153bb260bd7bef` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:21.479613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] RBAC: Authorizing `identity:get_user(user_id=6c374ad2a8a64c7481153bb260bd7bef)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:21.481225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:21.483281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 106/205] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:21 2022] GET /identity/v3/users/6c374ad2a8a64c7481153bb260bd7bef => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:21.488973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:21.617895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:21.641309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187be9-0e53-4ae3-926d-8022de346e68 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:21.685389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:21.686049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:21.686336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:21.686614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:21.780114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:21.781588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:21.883097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:21.904041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 100/206] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:21.909696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:22.030324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7adcbc-e59a-41bf-b3e4-79109fd839b2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:22.039398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:22.074347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a6c12-b3ec-45a5-8a94-3a2693bf6146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:22.075009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a6c12-b3ec-45a5-8a94-3a2693bf6146 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:22.075291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a6c12-b3ec-45a5-8a94-3a2693bf6146 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:22.075566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a6c12-b3ec-45a5-8a94-3a2693bf6146 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:22.076769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a6c12-b3ec-45a5-8a94-3a2693bf6146 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:22.078241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a6c12-b3ec-45a5-8a94-3a2693bf6146 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:22.080118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 107/207] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:21 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:22.086247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:22.231483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d379-09b0-424d-917a-d7c17d06d84e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:22.282858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:22.283509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:22.283793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:22.284070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:22.284895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] RBAC: Adding query filter params (role.id=b587cc9cc7964082838e9c4e2f1ee480, scope.project.id=404edea2367442d9aae1754fdc0c7db5, user.id=6c374ad2a8a64c7481153bb260bd7bef) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:22.285211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:22.286816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a643cf3-0a31-489c-a1cf-ad7000e34da6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:22.298254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 101/208] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:22 2022] GET /identity/v3/role_assignments?user.id=6c374ad2a8a64c7481153bb260bd7bef&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=b587cc9cc7964082838e9c4e2f1ee480 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:22.754648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d4a8f-0b9e-460e-8768-d58749016f76 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:22.755565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d4a8f-0b9e-460e-8768-d58749016f76 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:22.755771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d4a8f-0b9e-460e-8768-d58749016f76 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:22.757377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 108/209] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:22.763178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:22.763469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:22.763750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:22.788867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:22.790108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:22.804052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f007a9-6faa-4495-b659-650a3991d4da None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:22.804340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f007a9-6faa-4495-b659-650a3991d4da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:22.804612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f007a9-6faa-4495-b659-650a3991d4da None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:22.806124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 109/210] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:22.812316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:22.812608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:22.812891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:22.844264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:22.845915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:22.846828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:22.878631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 102/211] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:22.900317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:22.938844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 110/212] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:22.968113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.014060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812070e-1912-41af-94f9-d574cc3bd222 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.053150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.053833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.054116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.054389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.065585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:23.070728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:23.071593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:23.072369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:23.076868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 103/213] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:23.077856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.102302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e78bc-0a76-41f3-8b38-7c41f5737d9c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.112970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.122439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.153668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.154554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.155189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.156465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.170896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:23.177632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:23.178668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:23.179615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:23.182588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 111/214] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:23.188116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.195420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13527f-45d6-4a64-86e0-c084690afa97 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.232367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.233007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.233258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.233529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.234276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:23.234580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.235959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac593c-5890-41b3-89d3-bebc072ceede None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.244078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 104/215] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:23.245361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a803362-14d5-4820-a017-2ee22554f424 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.245690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a803362-14d5-4820-a017-2ee22554f424 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.245973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a803362-14d5-4820-a017-2ee22554f424 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.247334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 105/216] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:23.250732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6dcb-44ce-454a-beeb-63998b77a981 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.251023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6dcb-44ce-454a-beeb-63998b77a981 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.251411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6dcb-44ce-454a-beeb-63998b77a981 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.252525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 106/217] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:23.256587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6dcb-44ce-454a-beeb-63998b77a981 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.290248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577970ee-4f44-441c-b410-4629aa27aab8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.323559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.324165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.324444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.324716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.325416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:23.325749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.327137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603889e-1f9d-4341-9aef-f34151750fe0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.336013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 112/218] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:23.337140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.337422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.337732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.350890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.354788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6dcb-44ce-454a-beeb-63998b77a981 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.356077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:23.357260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:23.378969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.387696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165db380-dbdd-40ad-911b-92417a913a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.388339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db380-dbdd-40ad-911b-92417a913a5e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.388627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db380-dbdd-40ad-911b-92417a913a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.388905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db380-dbdd-40ad-911b-92417a913a5e None admin] PATH_INFO: `/v3/users/c4fabf96c7814842814f88311784bcc5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.390124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165db380-dbdd-40ad-911b-92417a913a5e None admin] RBAC: Authorizing `identity:get_user(user_id=c4fabf96c7814842814f88311784bcc5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.391573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165db380-dbdd-40ad-911b-92417a913a5e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.393191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 107/219] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/users/c4fabf96c7814842814f88311784bcc5 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:23.394391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.394686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.394964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.413106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:23.414331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:23.425179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 113/220] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:23.425980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.481915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 108/221] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:23.490497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.525386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f04fc-2173-46b5-abb8-f01041d9d1f4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.559678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.560244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.560526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.560802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] PATH_INFO: `/v3/users/1b415fc80502440d9a2345e21e92c7f3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.574518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] RBAC: Authorizing `identity:get_user(user_id=1b415fc80502440d9a2345e21e92c7f3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.576034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.577739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 114/222] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/users/1b415fc80502440d9a2345e21e92c7f3 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:23.578577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.583624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.587639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba48e53-3b03-436a-b6ca-41dab20ef98b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.596946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.623327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.624164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.624439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.624709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.625884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.627334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.628982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 109/223] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:23.629786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.680205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53584e-94b1-48d6-ab96-6b7f62cff470 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.712775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.713435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.713751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.714028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.715165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.716603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.718214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 115/224] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:23.722491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.729672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09c0b7-3aa8-4a32-8c56-9b28111b3868 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.762327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.762964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.763253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.763523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.773693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:23.778647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:23.779555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:23.780339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 110/225] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:23.780967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:23.805505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.808662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:23.821887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3416513-a804-45f2-abdc-ce2e3bbee8a4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.854950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.855565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.855849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.856127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.878479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3449-b0ff-4834-a69b-0ad80e43e70c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:23.912301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:23.912959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:23.913241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:23.913516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/c4fabf96c7814842814f88311784bcc5/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:23.915763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2b28c39a4f84b04afb3d148e7fc7, user_id=c4fabf96c7814842814f88311784bcc5, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.917468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.923617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:23.925106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:23.930689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 111/226] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:23 2022] PUT /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/c4fabf96c7814842814f88311784bcc5/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:23.934470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.016412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:24.038728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 116/227] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:24.042185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:24.044620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.062066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7057-b424-40e4-a651-32bdbeacadf7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.106644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.107614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.107918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.108198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.109183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.111209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.135041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 112/228] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:23 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:24.135718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.170627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95f48-51bf-4b5d-9076-dcfd195ed2ac None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.207598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.208928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.209213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.209491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.210292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:24.210604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.212052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.220965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 117/229] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:24.227092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.283320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edbb44-ddc9-4fe5-93a6-8a709cff2242 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.293324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:24.340411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.341117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.341439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.341706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.342894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.344354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.346384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 113/230] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:24 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:24.352833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.364514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767238-36fc-4723-b5d7-670b9d4149e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.366911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:24.402757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.403469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.403752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.404028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] PATH_INFO: `/v3/users/c4fabf96c7814842814f88311784bcc5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.405197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] RBAC: Authorizing `identity:get_user(user_id=c4fabf96c7814842814f88311784bcc5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.406699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.409683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 118/231] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:24 2022] GET /identity/v3/users/c4fabf96c7814842814f88311784bcc5 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:24.414502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.478247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add78b7-9a5e-44bc-adaa-a6c934911c88 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.515398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.516031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.516313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.516585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.517489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=1b415fc80502440d9a2345e21e92c7f3) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:24.517831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.519283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.526836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 114/232] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:24 2022] GET /identity/v3/role_assignments?user.id=1b415fc80502440d9a2345e21e92c7f3&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=696d13ce411c44db98ea6d86268618d9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:24.534633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeda86-b370-496e-9370-59e2c985fb86 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.551892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:24.575059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1acd8-d9a3-496d-8704-61c7ce23c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.576097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1acd8-d9a3-496d-8704-61c7ce23c31f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.576579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1acd8-d9a3-496d-8704-61c7ce23c31f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.577056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1acd8-d9a3-496d-8704-61c7ce23c31f None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.578602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1acd8-d9a3-496d-8704-61c7ce23c31f None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.580295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1acd8-d9a3-496d-8704-61c7ce23c31f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.582401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 119/233] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:24 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:24.588813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:24.679351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:24.708099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bfa4a-e034-412b-b48b-51f569b8a22e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:24.744842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f901195-d0a3-4da5-9c7f-f7a9f7cd4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:24.745523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901195-d0a3-4da5-9c7f-f7a9f7cd4358 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:24.745843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901195-d0a3-4da5-9c7f-f7a9f7cd4358 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:24.746176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901195-d0a3-4da5-9c7f-f7a9f7cd4358 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/c4fabf96c7814842814f88311784bcc5/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:24.748532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f901195-d0a3-4da5-9c7f-f7a9f7cd4358 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2b28c39a4f84b04afb3d148e7fc7, user_id=c4fabf96c7814842814f88311784bcc5, role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:24.750043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f901195-d0a3-4da5-9c7f-f7a9f7cd4358 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:24.766722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 115/234] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:24 2022] PUT /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/c4fabf96c7814842814f88311784bcc5/roles/95d5a16009d54ef398e385695bf7abcd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:26.309156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b15d-8130-4264-8e6d-7ac6c98e0a61 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.310161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b15d-8130-4264-8e6d-7ac6c98e0a61 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.310647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b15d-8130-4264-8e6d-7ac6c98e0a61 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.312192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 120/235] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:26.317271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.318085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.318584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.346673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:26.348280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:26.441983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:26.472826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b15d-8130-4264-8e6d-7ac6c98e0a61 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:26.603311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b15d-8130-4264-8e6d-7ac6c98e0a61 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:26.649092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c899a-ae28-49e0-9662-c6fed9c8a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:26.650123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c899a-ae28-49e0-9662-c6fed9c8a020 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.650632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c899a-ae28-49e0-9662-c6fed9c8a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.651106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c899a-ae28-49e0-9662-c6fed9c8a020 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.662515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c899a-ae28-49e0-9662-c6fed9c8a020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1f9c899a-ae28-49e0-9662-c6fed9c8a020 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:26.673622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:26.674532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:26.675308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:26.678649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 121/237] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:26.683989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:26.724326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45143c-61ce-4860-97be-d4ebbb3326f4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.724961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45143c-61ce-4860-97be-d4ebbb3326f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.725486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45143c-61ce-4860-97be-d4ebbb3326f4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.727177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 122/238] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:26.732995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.733579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.734085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.752866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:26.754465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:26.792769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:26.833209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:26.833619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 123/239] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:26.851334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:26.902493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2f31-8e86-42ea-98f5-ef306127b8e8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:26.945734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:26.946356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.946636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.946906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.947619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:26.947920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:26.949278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465730d2-b906-4d87-a35b-327fcb962e80 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:26.958138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 117/240] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:26.959195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c15f-b046-4d7d-8951-9399e680a75f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.959480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c15f-b046-4d7d-8951-9399e680a75f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.959750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c15f-b046-4d7d-8951-9399e680a75f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.960945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 118/241] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:26.961971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625064a-ac06-4ec9-9fa3-9b68451be09c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:26.962252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625064a-ac06-4ec9-9fa3-9b68451be09c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:26.962525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625064a-ac06-4ec9-9fa3-9b68451be09c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:26.965665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 119/242] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:26.965665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625064a-ac06-4ec9-9fa3-9b68451be09c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:26.986786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab46f4-bb55-47c2-a61e-d2fa480ccd5c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.020914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2380d4-0c41-4beb-84ca-8b94fc32717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.021551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2380d4-0c41-4beb-84ca-8b94fc32717a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.021873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2380d4-0c41-4beb-84ca-8b94fc32717a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.022167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2380d4-0c41-4beb-84ca-8b94fc32717a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.032063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2380d4-0c41-4beb-84ca-8b94fc32717a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-be2380d4-0c41-4beb-84ca-8b94fc32717a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:27.037564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:27.038660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:27.039613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 124/243] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:27.040375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.040464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.040678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.061908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:27.063102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:27.084396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625064a-ac06-4ec9-9fa3-9b68451be09c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.094944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.121996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.133200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5408dd-5166-4837-8e22-17a5b35b0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.133962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5408dd-5166-4837-8e22-17a5b35b0832 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.134253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5408dd-5166-4837-8e22-17a5b35b0832 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.134532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5408dd-5166-4837-8e22-17a5b35b0832 None admin] PATH_INFO: `/v3/users/c4fabf96c7814842814f88311784bcc5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.135712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5408dd-5166-4837-8e22-17a5b35b0832 None admin] RBAC: Authorizing `identity:get_user(user_id=c4fabf96c7814842814f88311784bcc5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.137157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5408dd-5166-4837-8e22-17a5b35b0832 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.138952 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 120/244] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:26 2022] GET /identity/v3/users/c4fabf96c7814842814f88311784bcc5 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:27.140101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.140386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.141009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.148838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 125/245] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:27.149156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.175699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:27.177337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:27.246456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 121/246] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:27.247429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.280884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13f89-9ff0-4789-af28-fc708f4fc8bb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.315635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.316255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.316524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.316800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.318077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:27.318380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.319751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.328138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 126/247] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:27.333882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.355643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4aace-884b-4d90-8527-731b0c5a436a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.358858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.386463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.399256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.399910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.400241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.400539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.443132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308966-6b2c-458d-9fbe-c6aa85226e03 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.474667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.476136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.476505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.477161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.477465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.477812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.488348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:27.493793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:27.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:27.495440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 127/248] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:27.496670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.586621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.588262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 122/249] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:27.589144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.606136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf33f73-a75a-4e67-b81d-ebc897439cdd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.615648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.643279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.643990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.644275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.644547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.646755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.648386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.650120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 128/250] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:27.650939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.697034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0c3c4-aa08-41e1-b6c5-06608315b5d6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.730161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.730790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.731069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.731340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] PATH_INFO: `/v3/users/eef718b728be4be8a531416d1eefdc5b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.746078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] RBAC: Authorizing `identity:get_user(user_id=eef718b728be4be8a531416d1eefdc5b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.747548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.749161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 123/251] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/users/eef718b728be4be8a531416d1eefdc5b => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:27.749933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.755835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df94f9-b42a-4944-bb32-141c13544032 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.789892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.790504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.790775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.791048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.792004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:27.792304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.793700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.801505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 129/252] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:27.803348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.819128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.830679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:27.850227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45332-a658-4ac4-a43d-bb9363ea5521 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.882827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1227fd8-d09e-4f6e-b4e4-7a70ee87a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.883457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227fd8-d09e-4f6e-b4e4-7a70ee87a372 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.883738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227fd8-d09e-4f6e-b4e4-7a70ee87a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.884007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227fd8-d09e-4f6e-b4e4-7a70ee87a372 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.885157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1227fd8-d09e-4f6e-b4e4-7a70ee87a372 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.886612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1227fd8-d09e-4f6e-b4e4-7a70ee87a372 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.888241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 124/253] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:27.893319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2963e51-854f-4bbd-b524-7f12986fe3ad None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.893319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2963e51-854f-4bbd-b524-7f12986fe3ad None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.893319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2963e51-854f-4bbd-b524-7f12986fe3ad None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.893319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 125/254] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:27.893319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2963e51-854f-4bbd-b524-7f12986fe3ad None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:27.906610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf569c-f9b3-4389-957f-9984a50bd701 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:27.943279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:27.943931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:27.944212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:27.944484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:27.945168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:27.946647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:27.969762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 130/255] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:27 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:27.970491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.000361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2963e51-854f-4bbd-b524-7f12986fe3ad None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.041512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f794fc-d998-4685-aeeb-fbf618949fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.042175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f794fc-d998-4685-aeeb-fbf618949fec None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.042461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f794fc-d998-4685-aeeb-fbf618949fec None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.042740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f794fc-d998-4685-aeeb-fbf618949fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.064763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.065517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.102663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dfa6-2764-49c6-9bbe-2c2fa8483403 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.123482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f794fc-d998-4685-aeeb-fbf618949fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.124949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f794fc-d998-4685-aeeb-fbf618949fec None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:28.143593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.144324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.144527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.144805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] PATH_INFO: `/v3/users/1b415fc80502440d9a2345e21e92c7f3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.146593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] RBAC: Authorizing `identity:get_user(user_id=1b415fc80502440d9a2345e21e92c7f3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.148045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:28.149670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 131/256] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/users/1b415fc80502440d9a2345e21e92c7f3 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:28.151244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.267502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 126/257] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:28.268833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.268833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.269116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.272271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab370f7-a73c-4e46-b56d-312f33b74ebd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.292455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:28.294201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:28.312160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.312779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.313059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.313333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.314299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=c4fabf96c7814842814f88311784bcc5) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:28.314719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.316156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:28.324764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 132/258] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:28 2022] GET /identity/v3/role_assignments?user.id=c4fabf96c7814842814f88311784bcc5&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:28.325653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.328679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.376005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.420711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 127/259] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:28.421589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.506852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7fcc-da0b-47c7-a352-2f06fbebc783 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.547764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.548594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.548889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.549167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.550493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.552002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:28.554266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 133/260] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:28 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:28.555067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.569992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe13127-2e6d-4b83-bce5-4681313911b2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.611457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.612699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.613228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.613799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.616190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.617918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:28.619895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 128/261] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:28 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:28.620979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.638002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.673922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704365c6-8226-44c3-b9d6-6b98d290d760 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.681197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.720922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.721573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.721888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.722167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.739844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:28.745608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:28.746487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:28.747255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 134/262] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:28.748374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.749829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35c70-e432-46fa-ad36-02e26a0d04f0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.788103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.789117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.789673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.790144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/1b415fc80502440d9a2345e21e92c7f3/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.792636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2b28c39a4f84b04afb3d148e7fc7, user_id=1b415fc80502440d9a2345e21e92c7f3, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.794428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:28.809104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 129/263] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:28 2022] PUT /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/1b415fc80502440d9a2345e21e92c7f3/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:28.817626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:28.919168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e5a5-e23d-4ae9-ad3d-45bbbdc66341 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:28.977749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:28.991916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:28.992544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:28.992825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:28.993100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:28.993968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] RBAC: Adding query filter params (role.id=b587cc9cc7964082838e9c4e2f1ee480, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=eef718b728be4be8a531416d1eefdc5b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:28.994279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:28.996697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:29.006502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 135/264] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:28 2022] GET /identity/v3/role_assignments?user.id=eef718b728be4be8a531416d1eefdc5b&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=b587cc9cc7964082838e9c4e2f1ee480 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:29.012522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b92943-6b31-43c9-a313-03924c22c366 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:29.028808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:29.061140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:29.061728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:29.062016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:29.062296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:29.063038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:29.063347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:29.064753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:29.074909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 130/265] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:29.080241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:29.223058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4cc88-03c8-4f2d-8853-8491b306790b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:29.269730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:29.270979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:29.271265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:29.271541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] PATH_INFO: `/v3/users/c4fabf96c7814842814f88311784bcc5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:29.272747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=c4fabf96c7814842814f88311784bcc5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:29.274226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:29.276823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 136/266] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:29 2022] GET /identity/v3/users/c4fabf96c7814842814f88311784bcc5 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:29.281351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:29.408859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8a284-e785-4a1d-9d0b-0028818d9e7a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:29.449225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:29.449880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:29.450240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:29.450530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:29.495630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:29.527956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:29.529496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:29.636463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 131/267] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:29.641771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:29.725441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:29.778033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd129b5-b958-49e2-9086-d686dd69f4d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:29.827710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1734e32-fc8b-4fd5-9028-211f7b7d532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:29.828369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734e32-fc8b-4fd5-9028-211f7b7d532a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:29.828656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734e32-fc8b-4fd5-9028-211f7b7d532a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:29.828934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734e32-fc8b-4fd5-9028-211f7b7d532a None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:29.830163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1734e32-fc8b-4fd5-9028-211f7b7d532a None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:29.831631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1734e32-fc8b-4fd5-9028-211f7b7d532a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:29.833353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 137/268] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:29 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:29.839187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:29.912676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:29.954563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e357d-af58-4f68-a734-837fce896ca8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:30.010306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:30.010945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.011240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.011572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.012709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] RBAC: Adding query filter params (role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=c4fabf96c7814842814f88311784bcc5) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:30.013031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:30.014500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb8e96-b76d-4ae4-b745-1eabc4628717 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:30.020975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 132/269] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:29 2022] GET /identity/v3/role_assignments?user.id=c4fabf96c7814842814f88311784bcc5&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=95d5a16009d54ef398e385695bf7abcd => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:30.450780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51eb7-5923-4be8-ab56-65e3b09c9724 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.457828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51eb7-5923-4be8-ab56-65e3b09c9724 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.458115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51eb7-5923-4be8-ab56-65e3b09c9724 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.459667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 138/270] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:30.465794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.466246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.466316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.484473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:30.485683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:30.543005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5ef0-86ee-48ff-b42a-70041f04c771 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.543308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5ef0-86ee-48ff-b42a-70041f04c771 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.543577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5ef0-86ee-48ff-b42a-70041f04c771 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.544909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 139/271] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:30.549960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.550240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.550516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.572848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:30.573709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 133/272] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:30.574150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:30.601279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:30.669207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 140/273] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:30.684325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:30.694785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:30.729979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9659f1-02d8-4200-a595-be88bd586de7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:30.766725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:30.777889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:30.779062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.779576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.780250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.795248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:30.803055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:30.803976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:30.804757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:30.807577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 134/274] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:30.813713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:30.819848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4db57-2e0a-4317-97ce-f6874a5748e8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:30.854505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:30.855143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.855423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.855699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.856845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:30.858353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:30.860185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 141/275] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:30.869149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:30.932632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0016e3e-9ea5-4dc4-8c31-11513d553001 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:30.964737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:30.978349 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:30.979108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:30.979399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:30.980049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:30.980872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:30.981284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:30.982882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:30.986406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcd5a5-7dc6-4dbf-b635-284146986ae7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:30.997677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 135/276] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:31.001565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:31.022881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:31.032079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:31.033048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.033334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.033906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.034604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:31.037072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:31.073886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 142/277] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:30 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:29:31.125492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562be8-415c-41e8-a685-1ef605a629c5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:31.164037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faec4a6-6b04-4127-8fd7-f99747f3d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:31.164696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec4a6-6b04-4127-8fd7-f99747f3d55f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.164981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec4a6-6b04-4127-8fd7-f99747f3d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.165257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faec4a6-6b04-4127-8fd7-f99747f3d55f None admin] PATH_INFO: `/v3/users/dfd578c6dc284e4faf4f77f3b96df781` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.182201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faec4a6-6b04-4127-8fd7-f99747f3d55f None admin] RBAC: Authorizing `identity:get_user(user_id=dfd578c6dc284e4faf4f77f3b96df781)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:31.183705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faec4a6-6b04-4127-8fd7-f99747f3d55f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:31.185820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 136/278] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/users/dfd578c6dc284e4faf4f77f3b96df781 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:31.191847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:31.280022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2513-0052-462c-b6cd-285e35740094 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.280351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2513-0052-462c-b6cd-285e35740094 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.280585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2513-0052-462c-b6cd-285e35740094 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.281962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 137/279] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:29:31.287749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bac69-68c8-44f6-9431-90f9479111b4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.288038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bac69-68c8-44f6-9431-90f9479111b4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.288294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bac69-68c8-44f6-9431-90f9479111b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.309900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9d4bac69-68c8-44f6-9431-90f9479111b4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:31.311021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035287f-fa10-4989-b29f-5742563633d9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:31.311132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9d4bac69-68c8-44f6-9431-90f9479111b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:31.350662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:31.351295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.351586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.351868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.352419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:31.356873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, user.id=dfd578c6dc284e4faf4f77f3b96df781, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:31.356873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:31.356873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:31.361682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 143/280] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/role_assignments?user.id=dfd578c6dc284e4faf4f77f3b96df781&scope.system=all&role.id=696d13ce411c44db98ea6d86268618d9 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:31.385498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 138/281] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:31.409299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:31.467976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:31.521518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419027-c99b-4172-b05d-5208f21e509a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.522069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419027-c99b-4172-b05d-5208f21e509a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.522179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419027-c99b-4172-b05d-5208f21e509a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.523633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 139/282] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:29:31.529839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.530173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.530402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.532952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b704ee-26d2-44fb-b6ec-7ed24a366cc8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:31.557514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:31.559163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:31.579107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:31.580211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.580818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.581318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.593749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:31.600626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:31.601546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:31.602417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:31.603595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 144/283] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:31.610667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:31.646081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 140/284] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:31.679815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:31.767149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8a98-fb34-487c-b5eb-01064ca3c9ab None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:31.783081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:31.814555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:31.815183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.815466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.815740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.816455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:31.816759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:31.819258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:31.844137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 145/285] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:31.850364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:31.892557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbe471-9b9e-419e-baee-a7aec33f4b44 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:31.909897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:31.940220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:31.941643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:31.941643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:31.941643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:31.962861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:31.968627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:31.969506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:31.970309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:31.975153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 141/286] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:31.977822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:32.013403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5335-3582-4e39-b4f8-026c19c14999 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.050901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:32.052190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:32.052489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:32.052767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] PATH_INFO: `/v3/users/1b415fc80502440d9a2345e21e92c7f3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:32.054011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] RBAC: Authorizing `identity:get_user(user_id=1b415fc80502440d9a2345e21e92c7f3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:32.055456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:32.057288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 146/287] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/users/1b415fc80502440d9a2345e21e92c7f3 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:32.062435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:32.109964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:32.172006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90708be-7f2c-4a63-b0b3-26c40fc5247a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.216001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:32.216631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:32.216915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:32.217192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:32.289731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:32.291601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:32.310276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f47ae-befe-495b-8be8-2bad02738723 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.349945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:32.409645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 147/288] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:32.415042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:32.417711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:32.418357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:32.418646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:32.418929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:32.419657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:32.419968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:32.421373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:32.442231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 142/289] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:32.450602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:32.526553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19095ab9-d699-4ed4-ad95-6f2524d2bec5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.543135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:32.567111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:32.567732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:32.568020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:32.568470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:32.569690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:32.571142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:32.574015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 148/290] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:32 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:32.580213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:32.589962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:32.683915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09c18e-43b4-4848-a692-8ba79c3d8890 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.703074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c09611-029e-4598-86a4-df9ff0d13238 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.724010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:32.724010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:32.724010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:32.724010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:32.724404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=1b415fc80502440d9a2345e21e92c7f3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:32.724404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:32.724404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:32.728461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 149/291] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:32 2022] GET /identity/v3/role_assignments?user.id=1b415fc80502440d9a2345e21e92c7f3&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=696d13ce411c44db98ea6d86268618d9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:32.790662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:32.791609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:32.791896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:32.792179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] PATH_INFO: `/v3/users/eef718b728be4be8a531416d1eefdc5b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:32.793538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] RBAC: Authorizing `identity:get_user(user_id=eef718b728be4be8a531416d1eefdc5b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:32.795066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:32.797041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 143/292] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:32 2022] GET /identity/v3/users/eef718b728be4be8a531416d1eefdc5b => generated 297 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:32.803466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:32.918063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:32.961427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00430c5d-3609-48f6-9f17-d7f3aa4ea502 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:32.999820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be29678-da7c-4fd8-8f79-1ea6e7b8e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:33.000469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be29678-da7c-4fd8-8f79-1ea6e7b8e606 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.000755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be29678-da7c-4fd8-8f79-1ea6e7b8e606 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.001096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be29678-da7c-4fd8-8f79-1ea6e7b8e606 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.003708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be29678-da7c-4fd8-8f79-1ea6e7b8e606 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:33.005276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be29678-da7c-4fd8-8f79-1ea6e7b8e606 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:33.007054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 150/293] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:32 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:33.012837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:33.117310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:33.124704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5dcc2-265f-4d31-8dc1-15aaefdfcb8c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:33.165051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509ad39-f081-48b1-b0ac-713a50db9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:33.166027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509ad39-f081-48b1-b0ac-713a50db9592 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.166697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509ad39-f081-48b1-b0ac-713a50db9592 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.167113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509ad39-f081-48b1-b0ac-713a50db9592 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/eef718b728be4be8a531416d1eefdc5b/roles/b587cc9cc7964082838e9c4e2f1ee480` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.170315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509ad39-f081-48b1-b0ac-713a50db9592 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2b28c39a4f84b04afb3d148e7fc7, user_id=eef718b728be4be8a531416d1eefdc5b, role_id=b587cc9cc7964082838e9c4e2f1ee480)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:33.171919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509ad39-f081-48b1-b0ac-713a50db9592 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:33.191103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 144/294] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:29:33 2022] PUT /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/users/eef718b728be4be8a531416d1eefdc5b/roles/b587cc9cc7964082838e9c4e2f1ee480 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:29:33.436073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ff7f-ed19-4e50-92f9-1f063e834d0b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.436311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ff7f-ed19-4e50-92f9-1f063e834d0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.436554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ff7f-ed19-4e50-92f9-1f063e834d0b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.438197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 151/295] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:33.443458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635491-2649-4c9e-afe2-0a1cf3f83ead None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.443750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635491-2649-4c9e-afe2-0a1cf3f83ead None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.444030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635491-2649-4c9e-afe2-0a1cf3f83ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.462269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5e635491-2649-4c9e-afe2-0a1cf3f83ead None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:33.463467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5e635491-2649-4c9e-afe2-0a1cf3f83ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:33.534430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 145/296] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:33.558294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8ff7f-ed19-4e50-92f9-1f063e834d0b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:33.595865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72c31-8fa3-4548-ae39-57d82c5e8779 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.596835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72c31-8fa3-4548-ae39-57d82c5e8779 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.597183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72c31-8fa3-4548-ae39-57d82c5e8779 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.599398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 146/297] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:29:33.604329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.604690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.605037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.624607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:33.625957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:33.683496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8ff7f-ed19-4e50-92f9-1f063e834d0b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:33.705954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 147/298] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:33.722628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:33.722833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:33.723318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.723598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.723909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.733299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:33.740721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:33.742426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:33.749336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:33.750235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:33.751003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 152/299] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:33.758609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:33.845051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547384e-c67e-431d-a657-1fd63a2c4d3b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:33.883035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:33.883686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.883969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.884242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.898980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfeaa8-41d4-4e50-9b43-cc3e9ac9f846 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:33.900322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:33.906778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:33.907650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:33.908418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 148/300] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:33.914446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:33.942864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:33.943791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.944296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.944769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.945729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:33.946238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:33.947836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366143fc-9dd0-4395-933c-92942fd747eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:33.963634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 153/301] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:33.965219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a00a-3105-4bf8-93fd-5a066f2d57c8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:33.965749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a00a-3105-4bf8-93fd-5a066f2d57c8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:33.966186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2a00a-3105-4bf8-93fd-5a066f2d57c8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:33.967446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 154/302] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:33.968138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a00a-3105-4bf8-93fd-5a066f2d57c8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:34.010981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:34.037220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ba47-6d45-4fa8-833d-dde3bdbed160 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.045760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:34.071541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.072150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.072431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.072702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.073408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:34.073755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.075117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43911103-8c30-4253-ac9f-13d8c8360e66 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.087872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 149/303] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:34.087872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.087872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.087872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.098059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2a00a-3105-4bf8-93fd-5a066f2d57c8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.103872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:34.105077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:34.133484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.134146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.134427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.134704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] PATH_INFO: `/v3/users/a998a54000154d78b89db2245ff4bf8c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.148939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a998a54000154d78b89db2245ff4bf8c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.150408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.152179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 155/304] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:33 2022] GET /identity/v3/users/a998a54000154d78b89db2245ff4bf8c => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:34.152776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:34.179451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 150/305] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:34.181791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:34.252518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:34.266688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784d08-e452-406b-b9ff-20fc215138a6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.284437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:34.290800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777725-c530-479c-9b16-3bddc38f90fd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.303225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.303863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.304143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.304414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] PATH_INFO: `/v3/users/dfd578c6dc284e4faf4f77f3b96df781` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.306322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] RBAC: Authorizing `identity:get_user(user_id=dfd578c6dc284e4faf4f77f3b96df781)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.307932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.309718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 156/306] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:34 2022] GET /identity/v3/users/dfd578c6dc284e4faf4f77f3b96df781 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:34.314988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:34.328795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.329432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.329749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.330024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.330834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] RBAC: Adding query filter params (role.id=b587cc9cc7964082838e9c4e2f1ee480, user.id=a998a54000154d78b89db2245ff4bf8c, scope.system=all) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:34.331144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.332735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.338431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 151/307] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 29 04:29:34 2022] GET /identity/v3/role_assignments?user.id=a998a54000154d78b89db2245ff4bf8c&scope.system=all&role.id=b587cc9cc7964082838e9c4e2f1ee480 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:34.339259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:34.449785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57608dc6-310d-473f-8936-99032b7e627e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.473632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02076e9-62ba-435d-862b-f78005c3a4ab None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.498039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.498738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.499025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.499296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.500458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.502378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.505794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 157/308] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:34.511131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:34.521577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:34.530791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84927a-0b90-473f-ac1a-55cf08c61d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.531723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84927a-0b90-473f-ac1a-55cf08c61d6c None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.532344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84927a-0b90-473f-ac1a-55cf08c61d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.532751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84927a-0b90-473f-ac1a-55cf08c61d6c None admin] PATH_INFO: `/v3/system/users/dfd578c6dc284e4faf4f77f3b96df781/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.534857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84927a-0b90-473f-ac1a-55cf08c61d6c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dfd578c6dc284e4faf4f77f3b96df781, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.537033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84927a-0b90-473f-ac1a-55cf08c61d6c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.548922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 152/309] 10.222.0.46 () {58 vars in 1334 bytes} [Fri Jul 29 04:29:34 2022] PUT /identity/v3/system/users/dfd578c6dc284e4faf4f77f3b96df781/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:34.581995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:34.637037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb09ef-b2bd-47ba-a5b2-5d626fa66c97 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:34.675712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af95fc-0ce1-405a-821f-3684103239b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:34.676957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af95fc-0ce1-405a-821f-3684103239b1 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:34.677236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af95fc-0ce1-405a-821f-3684103239b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:34.677509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af95fc-0ce1-405a-821f-3684103239b1 None admin] PATH_INFO: `/v3/groups` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:34.678220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af95fc-0ce1-405a-821f-3684103239b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:34.679681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af95fc-0ce1-405a-821f-3684103239b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:34.700857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 158/310] 10.222.0.46 () {60 vars in 1134 bytes} [Fri Jul 29 04:29:34 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:35.264243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39be3d-183b-4f5d-b29c-ad0098544be8 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:35.264791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39be3d-183b-4f5d-b29c-ad0098544be8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:35.264791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39be3d-183b-4f5d-b29c-ad0098544be8 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:35.266524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 153/311] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:35.272575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:35.272985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:35.273190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:35.292411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:35.293635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:35.367800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 159/312] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:35.390011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39be3d-183b-4f5d-b29c-ad0098544be8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:35.497842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39be3d-183b-4f5d-b29c-ad0098544be8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:35.534052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:35.534611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:35.534891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:35.535165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:35.545876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:35.551510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:35.554316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:35.556246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 154/313] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:35.561622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:35.608066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:35.666003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7bbdb-b163-4b3f-bdb7-a8007473871d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:35.701395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:35.702038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:35.702318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:35.702586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:35.703291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:35.703591 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:35.704955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:35.713459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 160/314] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:35.718955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:35.780302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:35.828854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f07fa6-036d-4cd0-897d-43f4450e91ac None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:35.863275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:35.864483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:35.864767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:35.865038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] PATH_INFO: `/v3/users/eef718b728be4be8a531416d1eefdc5b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:35.866237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] RBAC: Authorizing `identity:get_user(user_id=eef718b728be4be8a531416d1eefdc5b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:35.867689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:35.869282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 155/315] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:35 2022] GET /identity/v3/users/eef718b728be4be8a531416d1eefdc5b => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:35.875009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:35.982992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a2cc3-dd85-4241-ab97-230ebb14b7b5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:35.997929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:36.017318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:36.017963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.018245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.018519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.087477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:36.088854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:36.188949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 161/316] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:36.194483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:36.297847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20298a-3170-46c2-8449-1c44a4c11c13 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:36.320783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:36.333400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743df92c-e5e4-4f57-b5c0-b532c6248fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:36.334075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743df92c-e5e4-4f57-b5c0-b532c6248fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.334355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743df92c-e5e4-4f57-b5c0-b532c6248fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.334630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743df92c-e5e4-4f57-b5c0-b532c6248fa9 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.335799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743df92c-e5e4-4f57-b5c0-b532c6248fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:36.337254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743df92c-e5e4-4f57-b5c0-b532c6248fa9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:36.338975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 156/317] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:36 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:36.344869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:36.357946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:36.417661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf68e-7956-43b7-b368-13a1f82574be None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.417661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf68e-7956-43b7-b368-13a1f82574be None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.417661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf68e-7956-43b7-b368-13a1f82574be None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.418536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 157/318] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:29:36.425627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306895-690b-4965-b367-fee64026dea4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.425627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306895-690b-4965-b367-fee64026dea4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.425627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306895-690b-4965-b367-fee64026dea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.443923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-92306895-690b-4965-b367-fee64026dea4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:36.445434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-92306895-690b-4965-b367-fee64026dea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:36.452978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0487-4a0f-4de6-9339-2e32dba5f7b9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:36.496774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:36.497398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.497701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.497977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.499063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] RBAC: Adding query filter params (role.id=b587cc9cc7964082838e9c4e2f1ee480, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7, user.id=eef718b728be4be8a531416d1eefdc5b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:36.499373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:36.500818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:36.509415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 162/319] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:29:36 2022] GET /identity/v3/role_assignments?user.id=eef718b728be4be8a531416d1eefdc5b&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=b587cc9cc7964082838e9c4e2f1ee480 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:36.533255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 158/320] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:36.555948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:36.632602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:36.661117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00f2c-db9e-4c3f-aa13-fcd929f16cc3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.661378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00f2c-db9e-4c3f-aa13-fcd929f16cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.661704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa00f2c-db9e-4c3f-aa13-fcd929f16cc3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.663377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 159/321] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:36.668125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573ad15-aa60-4ee1-9af2-43c4b9b20614 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:36.668982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.669274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.669546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.688668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:36.692077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:36.705962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:36.706614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.706899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.707178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.719501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:36.725215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:36.726185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:36.727142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:36.727807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 163/322] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:36.732467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:36.778769 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 160/323] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:36.802582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:36.846166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda5a9c-15db-4ae8-81ac-50811748cd04 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:36.856304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:36.874640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:36.882234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:36.882905 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.883169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.883444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.884545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:36.884856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:36.886611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc15b9-f348-42fe-8f45-15210aa9423a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:36.894681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 164/324] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:36.895873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8430e-2795-4233-9f00-17fe4e4cf95e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.896165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8430e-2795-4233-9f00-17fe4e4cf95e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.896445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8430e-2795-4233-9f00-17fe4e4cf95e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.897675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 165/325] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:36.900286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8430e-2795-4233-9f00-17fe4e4cf95e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:36.908954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb3c76-e198-4203-b7af-392d844dc4e6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:36.946424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bd4e5-2eb4-4e64-b631-6cfdc4ee5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:36.947075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd4e5-2eb4-4e64-b631-6cfdc4ee5a40 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.947359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd4e5-2eb4-4e64-b631-6cfdc4ee5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.947641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd4e5-2eb4-4e64-b631-6cfdc4ee5a40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.958060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bd4e5-2eb4-4e64-b631-6cfdc4ee5a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-212bd4e5-2eb4-4e64-b631-6cfdc4ee5a40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:36.963052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:36.963884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:36.964651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 161/326] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:36.965741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:36.965741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:36.965969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:36.983132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:36.984331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:37.004793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8430e-2795-4233-9f00-17fe4e4cf95e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.037852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.038492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.038774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.039057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] PATH_INFO: `/v3/users/a998a54000154d78b89db2245ff4bf8c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.040205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] RBAC: Authorizing `identity:get_user(user_id=a998a54000154d78b89db2245ff4bf8c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.041948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.043812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 166/327] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:36 2022] GET /identity/v3/users/a998a54000154d78b89db2245ff4bf8c => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:37.044448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:37.049135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 162/328] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:37.049895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:37.091553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:37.102647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:37.146836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0ecd6-0da0-4858-8cf4-d0532e9eddc7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.149174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba191dd5-00c0-4df4-9852-3590165780c4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.179875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.180485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.180773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.181052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.181800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:37.182108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.182547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.183202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.183469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.183580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.183765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] PATH_INFO: `/v3/system/users/a998a54000154d78b89db2245ff4bf8c/roles/b587cc9cc7964082838e9c4e2f1ee480` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.185343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a998a54000154d78b89db2245ff4bf8c, role_id=b587cc9cc7964082838e9c4e2f1ee480)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.187324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.191612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 167/329] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:37.192910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:37.199497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 163/330] 10.222.0.46 () {58 vars in 1334 bytes} [Fri Jul 29 04:29:37 2022] PUT /identity/v3/system/users/a998a54000154d78b89db2245ff4bf8c/roles/b587cc9cc7964082838e9c4e2f1ee480 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:37.202525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:37.305112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488362d-d1ac-4d32-8c23-43018f3b4799 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.320709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3fb6-14a5-4dca-b951-b10488ded43d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.323344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:37.330311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:37.343849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.344505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.344790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.345065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.346242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.347689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.349335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 168/331] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:37.354847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:37.365349 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.367766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.367766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.367766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] PATH_INFO: `/v3/users/dfd578c6dc284e4faf4f77f3b96df781` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.367766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] RBAC: Authorizing `identity:get_user(user_id=dfd578c6dc284e4faf4f77f3b96df781)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.369232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.370901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 164/332] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:37 2022] GET /identity/v3/users/dfd578c6dc284e4faf4f77f3b96df781 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:37.376806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:37.463653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13720112-f189-4066-93f8-d2156f7b6cec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.482375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548360a-98cf-4c8d-bafc-7d979c9cbfae None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:37.499100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278646-e8ee-4551-a86e-c9ea130c300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.499711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278646-e8ee-4551-a86e-c9ea130c300e None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.499990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278646-e8ee-4551-a86e-c9ea130c300e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.500262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278646-e8ee-4551-a86e-c9ea130c300e None admin] PATH_INFO: `/v3/groups` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.500919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc278646-e8ee-4551-a86e-c9ea130c300e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.502372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc278646-e8ee-4551-a86e-c9ea130c300e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.525636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 169/333] 10.222.0.46 () {60 vars in 1134 bytes} [Fri Jul 29 04:29:37 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:29:37.526978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:37.527635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:37.527919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:37.528256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:37.529062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] RBAC: Adding query filter params (role.id=696d13ce411c44db98ea6d86268618d9, user.id=dfd578c6dc284e4faf4f77f3b96df781, scope.system=all) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:37.529376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:37.530901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81435c-bf93-427c-9914-6ff26fb6a277 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:37.553628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 165/334] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 29 04:29:37 2022] GET /identity/v3/role_assignments?user.id=dfd578c6dc284e4faf4f77f3b96df781&scope.system=all&role.id=696d13ce411c44db98ea6d86268618d9 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:39.338137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905be99-5bf6-49cb-811a-049c3415e3d3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:39.338647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905be99-5bf6-49cb-811a-049c3415e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:39.338744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905be99-5bf6-49cb-811a-049c3415e3d3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:39.340269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 170/335] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:39.346015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:39.346852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:39.347138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:39.372798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:39.374042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:39.401135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:39.448019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 166/336] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:39.484478 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905be99-5bf6-49cb-811a-049c3415e3d3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:39.560518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:39.618647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905be99-5bf6-49cb-811a-049c3415e3d3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:39.662854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8d96-f430-4a13-83bb-e83faa0818fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:39.663886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8d96-f430-4a13-83bb-e83faa0818fb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:39.664396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8d96-f430-4a13-83bb-e83faa0818fb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:39.664866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8d96-f430-4a13-83bb-e83faa0818fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:39.680534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a8d96-f430-4a13-83bb-e83faa0818fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fb8a8d96-f430-4a13-83bb-e83faa0818fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:39.686355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:39.687216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 29 04:29:39.687999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:39.690628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 171/337] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:39.696728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:39.947547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53eade-8f42-4595-8eae-bad8e99d0e7a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:39.948190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53eade-8f42-4595-8eae-bad8e99d0e7a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:39.948668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53eade-8f42-4595-8eae-bad8e99d0e7a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:39.950506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 172/338] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:39.956579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:39.957124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:39.958156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:39.959023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599238d-8df4-4507-a809-167aebeb3936 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.002659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:40.004298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:40.015556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.016199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.016485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.016760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.017489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:40.017825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:40.021033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:40.037038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 167/339] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:40.042924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.086704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:40.146016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 173/340] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:40.182537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.216025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a59ed-5826-4028-a44c-bdb9d1fabe2c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.239190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:40.300002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e42cca-b0b7-49a4-a843-6bd3ea03f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.300663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e42cca-b0b7-49a4-a843-6bd3ea03f996 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.300945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e42cca-b0b7-49a4-a843-6bd3ea03f996 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.301249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e42cca-b0b7-49a4-a843-6bd3ea03f996 None admin] PATH_INFO: `/v3/users/a998a54000154d78b89db2245ff4bf8c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.303547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e42cca-b0b7-49a4-a843-6bd3ea03f996 None admin] RBAC: Authorizing `identity:get_user(user_id=a998a54000154d78b89db2245ff4bf8c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:40.305003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e42cca-b0b7-49a4-a843-6bd3ea03f996 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:40.310226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 168/341] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/users/a998a54000154d78b89db2245ff4bf8c => generated 293 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:40.311432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1eb9c-ec98-42c0-8699-712848ab9c63 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.311712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1eb9c-ec98-42c0-8699-712848ab9c63 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.311983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1eb9c-ec98-42c0-8699-712848ab9c63 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.319672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 169/342] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:40.321860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.322140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.322413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.330698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062f5c0-fbc2-4063-af57-009e9df062df None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.362748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:40.363979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:40.401163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.401870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.402109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.402377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.426970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:40.435439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:40.437836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:40.439762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 174/343] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:40.450976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.505115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 170/344] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:40.505815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.549729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:40.642844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:40.647862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3000e6e-12c9-4fef-bddd-81b4ae30833c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.653252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e807836-9102-4d79-b30d-62a761fcf7a2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.690214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.690763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.691100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.691376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.692181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:40.692492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:40.693883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:40.699288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.699931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.700211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.700485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.701271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] RBAC: Adding query filter params (role.id=b587cc9cc7964082838e9c4e2f1ee480, user.id=a998a54000154d78b89db2245ff4bf8c, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:40.701578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:40.702220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 171/345] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:40.703030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.704413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:40.718425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 175/346] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/role_assignments?user.id=a998a54000154d78b89db2245ff4bf8c&scope.system=all&role.id=b587cc9cc7964082838e9c4e2f1ee480 => generated 510 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:40.719269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.828743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78d2ad-a27d-4ce8-8565-41a1cc3a7e93 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.846009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:40.856664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799bbfb-46e5-4a99-93db-7a3fb27ebd94 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:40.867270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b7590-21e0-4cf7-b4ee-fa0f58fee436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.867911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7590-21e0-4cf7-b4ee-fa0f58fee436 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.868190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7590-21e0-4cf7-b4ee-fa0f58fee436 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.868465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7590-21e0-4cf7-b4ee-fa0f58fee436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.896260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efedc8-b772-4778-97d1-6c6df2c0257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:40.896955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efedc8-b772-4778-97d1-6c6df2c0257e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.897237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efedc8-b772-4778-97d1-6c6df2c0257e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.897561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efedc8-b772-4778-97d1-6c6df2c0257e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.901635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:40.911573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efedc8-b772-4778-97d1-6c6df2c0257e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-28efedc8-b772-4778-97d1-6c6df2c0257e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:40.917587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:40.918600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:40.919395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 172/347] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:40.920510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8529b45-29f4-4f04-b466-6b72fc17191c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:40.925233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8529b45-29f4-4f04-b466-6b72fc17191c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:40.925233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8529b45-29f4-4f04-b466-6b72fc17191c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:40.925233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 173/348] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:40.926387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8529b45-29f4-4f04-b466-6b72fc17191c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:40.952943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b7590-21e0-4cf7-b4ee-fa0f58fee436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:40.954953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b7590-21e0-4cf7-b4ee-fa0f58fee436 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.052502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8529b45-29f4-4f04-b466-6b72fc17191c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.073012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 176/349] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:41.074582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.075042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.075484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.100446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:41.101348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.101697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:41.102395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.102926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.103367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.104582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:41.107933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:41.109668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.124924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 174/350] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:41.126598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.138713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:41.188768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:41.205587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 177/351] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:41.206211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.283257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb048-0175-43c4-b843-a4ed41c2056c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.336145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.336576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.336866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.337146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.341631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:41.342314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.344601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 175/352] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:41.345458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.374030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57906a54-7ab8-4bef-9d4c-e78730c1a847 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.412770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2273967-071a-4a5b-8412-e4548a9ee08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.413505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2273967-071a-4a5b-8412-e4548a9ee08e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.413813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2273967-071a-4a5b-8412-e4548a9ee08e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.414101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2273967-071a-4a5b-8412-e4548a9ee08e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.433581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:41.475692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88179b44-97c7-45ba-a935-a8ce16d8b5de None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.495107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:41.512689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2273967-071a-4a5b-8412-e4548a9ee08e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:41.514123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2273967-071a-4a5b-8412-e4548a9ee08e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.522332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.522989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.523699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.523985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.539588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:41.545854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:41.546709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:41.547497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 176/353] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:41.548130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.650151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 178/354] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:41.651438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5b2a-0a6e-4e54-af7f-9ff3169d38b0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.651730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5b2a-0a6e-4e54-af7f-9ff3169d38b0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.652009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef5b2a-0a6e-4e54-af7f-9ff3169d38b0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.653390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 179/355] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:41.653983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef5b2a-0a6e-4e54-af7f-9ff3169d38b0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.683001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528282-5cd3-430d-a9f2-481b8b741b40 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.721898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:41.731362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.732598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.733205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.734238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.743323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:41.744816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.746584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 177/356] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:41.747868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.780930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:41.798999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef5b2a-0a6e-4e54-af7f-9ff3169d38b0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.847573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.849191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.849191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.849357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.850063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:41.850372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:41.851768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57659aac-8ca5-4d41-b1fc-94dc19a75a0f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.861406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 180/357] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:41.862764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.863143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.863481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.883159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:41.884376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:41.888890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5d7b1-9376-43f9-9206-c637a22cf937 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:41.955599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:41.956501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:41.956501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:41.956797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:41.958066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:41.959541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:41.961191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 178/358] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:41.962223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:41.980329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 181/359] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:41.981111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.038733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.088577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.097620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67917-24bc-4e45-ab58-089a4fc7b7d5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.116411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51948a57-6451-4d9b-b10e-a65d17535a49 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.136075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.136710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.136993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.137271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.138127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=404edea2367442d9aae1754fdc0c7db5) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:42.138448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.139885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.146401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 179/360] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=95d5a16009d54ef398e385695bf7abcd => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:42.147279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.158520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187cf98-f1b7-4be5-9cf7-afac17b266d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.159164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187cf98-f1b7-4be5-9cf7-afac17b266d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.159743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187cf98-f1b7-4be5-9cf7-afac17b266d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.159743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187cf98-f1b7-4be5-9cf7-afac17b266d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.262106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187cf98-f1b7-4be5-9cf7-afac17b266d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.265589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187cf98-f1b7-4be5-9cf7-afac17b266d7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.288381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa91d8-ce42-4f67-8f57-b60801c5afc3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.319325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.334661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.335324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.335612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.335894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.337179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.338689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.340455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 180/361] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:42.341064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.385471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.413243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 182/362] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:42.418353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa8ccb-7835-4d57-99ab-7ff32a9d1fb8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.418353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa8ccb-7835-4d57-99ab-7ff32a9d1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.418353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa8ccb-7835-4d57-99ab-7ff32a9d1fb8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.418353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 183/363] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:42.418353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa8ccb-7835-4d57-99ab-7ff32a9d1fb8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.470240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23de46-596e-458e-a216-fe8ef61edf63 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.513040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.513040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.514131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.514415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.526669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:42.532193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:42.533059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:42.533868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 181/364] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:42.534501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.552051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa8ccb-7835-4d57-99ab-7ff32a9d1fb8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.604213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.604769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.605050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.605320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.606155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=404edea2367442d9aae1754fdc0c7db5) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:42.606461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.608546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430f2a1-06ee-4225-bb4e-6fc21d58dbff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.613714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.617300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 184/365] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=696d13ce411c44db98ea6d86268618d9 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:42.618996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.619286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.619561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.643893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:42.645975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:42.675050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c53e-2feb-4c72-96af-a0c0271eac43 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.703782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.716954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.718078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.718586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.719073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.720583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.722598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.725190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 182/366] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:42.726362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.751333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 185/367] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:42.752262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.862795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918292a6-494b-4416-b662-f9c7621bf911 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.880473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c79fc-35dc-407f-aa30-f22544e95099 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:42.897586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:42.911342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.912244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.912536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.913062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.914227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:42.914552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.916601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.920045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:42.920699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:42.920992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:42.921270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:42.922495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:42.924049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:42.926505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 186/368] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:42.929450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 183/369] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:42.929621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.932870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:42.990018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.074510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c3e8-51d5-4061-83f4-87257ce767a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.079832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48122c-13f1-46c2-ad01-6a71e94fc20b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.120000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.120877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.121205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.121570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.121887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.122165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.122279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.122768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.123763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:43.124285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.126924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.133704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 184/370] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=696d13ce411c44db98ea6d86268618d9 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:43.133854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:43.134892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:43.143480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:43.144491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:43.145412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 187/371] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:43.151407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.194192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.253709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d36c3b-e0a9-4df2-a385-3c0f0bc38bd5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.290870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023caf24-bf8c-4bc3-a309-cd1ca66dc702 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.293079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.295371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.296255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.297696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.297696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.332311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.332945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.333226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.333820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.334314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:43.334750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.336148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.346044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 188/372] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:43.352417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.381569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.383450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.442466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.468538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b3d1-b780-43ee-a49a-0368ffa9a0c9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.500070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 185/373] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:43.506409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.507747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.508390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.508675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.508954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.543400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.584331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.585868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.615459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641f2bc-7f1c-42aa-9eb1-69b74b031652 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.654806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.655432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.655724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.656006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.657202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.658753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.660806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 186/374] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:43.666139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.689875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.692967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 189/375] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:43.698512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.764618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.778787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d277a9-ad36-4af3-b57c-1308c1d2d5e6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.807816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b7fc-181b-4993-a8aa-b7083a81c1e3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.820515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.821176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.821473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.821802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.823301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.824758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.826881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 187/376] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:43.832885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.849392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.850083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.850366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.851549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] PATH_INFO: `/v3/projects/c3845060db6a456e8e10c94484cbc67c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.853094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] RBAC: Authorizing `identity:get_project(project_id=c3845060db6a456e8e10c94484cbc67c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:43.854693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:43.856653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 190/377] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/projects/c3845060db6a456e8e10c94484cbc67c => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:43.862027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:43.939414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:43.958553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a168-7d17-4171-81f5-d9bbf9017c7e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.970013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c67ae-a340-4a71-8860-0e064d82ae9e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:43.997011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:43.998063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:43.998594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:43.999031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:43.999965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:44.000455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:44.001562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:44.003626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:44.006982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf2eb-3660-4551-a306-51e807939d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:44.007990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf2eb-3660-4551-a306-51e807939d11 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:44.008784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf2eb-3660-4551-a306-51e807939d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:44.008784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf2eb-3660-4551-a306-51e807939d11 None admin] PATH_INFO: `/v3/groups/1b36acb257c646f5a84fa4c726ab64bc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:44.012598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 188/378] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=95d5a16009d54ef398e385695bf7abcd => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:44.015739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcf2eb-3660-4551-a306-51e807939d11 None admin] RBAC: Authorizing `identity:get_group(group_id=1b36acb257c646f5a84fa4c726ab64bc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:44.017481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcf2eb-3660-4551-a306-51e807939d11 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:44.019556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 191/379] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:43 2022] GET /identity/v3/groups/1b36acb257c646f5a84fa4c726ab64bc => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:44.025700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:44.139676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f9ad-4cf1-4dd4-a6c3-722652747d0f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:44.178951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:44.179597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:44.179883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:44.180164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:44.181071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] RBAC: Adding query filter params (group.id=1b36acb257c646f5a84fa4c726ab64bc, role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=c3845060db6a456e8e10c94484cbc67c) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:44.181343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:44.182889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4f677-695a-4b7f-b736-f6146e1a6638 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:44.192128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 189/380] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:44 2022] GET /identity/v3/role_assignments?group.id=1b36acb257c646f5a84fa4c726ab64bc&scope.project.id=c3845060db6a456e8e10c94484cbc67c&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:45.023086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24e3d2-ebe2-4509-9452-ac140c7f4c24 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.024048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24e3d2-ebe2-4509-9452-ac140c7f4c24 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.024539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24e3d2-ebe2-4509-9452-ac140c7f4c24 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.026424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 192/381] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:45.031380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.032243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.032749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.057919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:45.059472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:45.070094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:45.120357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94bb5c-3f30-4f03-a9d4-88471ed0a2c7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.121015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94bb5c-3f30-4f03-a9d4-88471ed0a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.121497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94bb5c-3f30-4f03-a9d4-88471ed0a2c7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.125965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 193/382] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:45.134240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.134530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.134817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.162685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:45.163894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:45.172914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 190/383] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:45.202749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.322707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7a347-2309-4aca-a840-048f78ffe7bc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:45.331779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 194/384] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:45.370743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.378288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:45.380502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.380792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.381117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.392856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:45.398065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:45.398938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:45.399745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:45.400348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 191/385] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:29:45.406387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.415667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:45.530161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6387-823a-442e-9bbb-74d0cc82d2e7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:45.560927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:45.571117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:45.571807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.572090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.572411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.583294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:45.588396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:45.589304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:45.590211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:45.594026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 195/386] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:45.595621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.596168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818123-e7cf-47c0-b61b-d4dd81644839 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:45.634311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:45.635306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.635813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.636298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.637227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:45.637803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:45.639392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:45.651165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 192/387] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:45.658878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.712071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cade9f9-3934-4520-ade6-2476ea20ef23 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:45.754063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:45.780306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be2df9-71c3-415a-9311-8492560ff6e0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:45.818858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:45.819851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.820356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.820849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.822296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:45.822928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:45.823155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:45.823274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:45.823469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:45.824185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:45.824486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:45.825499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:45.826013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:45.828184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 193/388] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:45.835115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.848710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 196/389] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:45.853937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:45.961749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:46.007360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4d37a-a03d-4902-a95d-e62abe46ffa5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.048235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.048849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.049086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.049365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.051682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:46.053130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:46.055189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 194/390] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:46.063653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.069556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda814-87e8-4a3f-a79f-96677966cada None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.072376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:46.116606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.118071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.118496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.118935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.120221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:46.121830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:46.124379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 197/391] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:45 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:46.130015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.228522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaa440-5a99-4b57-8bab-cecc10781dd2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.265092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892a7a-8cb2-4871-968d-b4c2b63830b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.266109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892a7a-8cb2-4871-968d-b4c2b63830b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.266575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892a7a-8cb2-4871-968d-b4c2b63830b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.267042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892a7a-8cb2-4871-968d-b4c2b63830b5 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5/groups/d521cb24d07a4e7fae16d6807749b90e/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.269331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892a7a-8cb2-4871-968d-b4c2b63830b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=404edea2367442d9aae1754fdc0c7db5, group_id=d521cb24d07a4e7fae16d6807749b90e, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:46.271107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892a7a-8cb2-4871-968d-b4c2b63830b5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:46.297686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6648-64c2-4cdc-9922-c0f75b479241 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.298529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 195/392] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 29 04:29:46 2022] PUT /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5/groups/d521cb24d07a4e7fae16d6807749b90e/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:46.304798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9ffe-b6d5-4f43-a2fd-99d3b9233b99 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.305340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9ffe-b6d5-4f43-a2fd-99d3b9233b99 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.308920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9ffe-b6d5-4f43-a2fd-99d3b9233b99 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.310842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 196/393] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:46.323656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:46.327499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.328031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.328454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.363124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:46.365432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:46.380173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.381104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.383261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.383740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.385471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:46.389071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:46.392756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 198/394] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:46 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:46.398992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.478943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:46.490422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 197/395] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:46.512628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.545436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2c42e-1429-45b9-885b-df8a745a8712 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.586436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f2b66-ac4c-4783-9955-091d7c2c4a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.587606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f2b66-ac4c-4783-9955-091d7c2c4a81 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.588033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f2b66-ac4c-4783-9955-091d7c2c4a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.588992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f2b66-ac4c-4783-9955-091d7c2c4a81 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5/groups/d521cb24d07a4e7fae16d6807749b90e/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.592926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f2b66-ac4c-4783-9955-091d7c2c4a81 None admin] RBAC: Authorizing `identity:create_grant(project_id=404edea2367442d9aae1754fdc0c7db5, group_id=d521cb24d07a4e7fae16d6807749b90e, role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:46.594583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f2b66-ac4c-4783-9955-091d7c2c4a81 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:46.612269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 199/396] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 29 04:29:46 2022] PUT /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5/groups/d521cb24d07a4e7fae16d6807749b90e/roles/95d5a16009d54ef398e385695bf7abcd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:29:46.614641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec43d-c4f2-498c-8183-719cf782e58c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.615090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec43d-c4f2-498c-8183-719cf782e58c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.615829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec43d-c4f2-498c-8183-719cf782e58c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.618799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 200/397] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:46.624537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.624824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.625258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.630983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0d4e-01d6-44c3-ab75-fd46be37ed73 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.647597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:46.648862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:46.682070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.683526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.684058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.684890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.695381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:46.700863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:46.708311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:46.709443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:46.710432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:46.713489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 198/398] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:46.718506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.734166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 201/399] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:46.761319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.785202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:46.851629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b58f7-cf08-4a72-99b7-6310dfe6e313 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.888384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e73a5-5d0a-40f8-88a9-3b98ff22396a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:46.910755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.911385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.911671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.911947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.912670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:46.912980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:46.914511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:46.923880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 199/400] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:46.931535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:46.936579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8342f-2439-40a8-a7a6-695f08c3aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:46.937469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8342f-2439-40a8-a7a6-695f08c3aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.937943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8342f-2439-40a8-a7a6-695f08c3aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.938351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8342f-2439-40a8-a7a6-695f08c3aa1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.950634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8342f-2439-40a8-a7a6-695f08c3aa1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-65b8342f-2439-40a8-a7a6-695f08c3aa1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:46.955195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:46.956216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:46.957271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:46.960622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 202/401] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:46.960622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e301-48a3-4e08-9ebc-679966fbc8dd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:46.960902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e301-48a3-4e08-9ebc-679966fbc8dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:46.961305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e301-48a3-4e08-9ebc-679966fbc8dd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:46.962662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 203/402] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:46.965861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e301-48a3-4e08-9ebc-679966fbc8dd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.041748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d242e-8a8c-47cd-bc43-0314ce94fafc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.050077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.056189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.079345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8558f3-009c-4020-a956-229182c687cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.079994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8558f3-009c-4020-a956-229182c687cf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.080279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8558f3-009c-4020-a956-229182c687cf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.080562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8558f3-009c-4020-a956-229182c687cf None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.081896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8558f3-009c-4020-a956-229182c687cf None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.083642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8558f3-009c-4020-a956-229182c687cf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.085554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 200/403] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:46 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:47.086890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.087297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.087589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.098273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e301-48a3-4e08-9ebc-679966fbc8dd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.107136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:47.108263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:47.141930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.142614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.142973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.143256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.144073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:47.144384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.145912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.155028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 204/404] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:47.155878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.184030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 201/405] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:47.185458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.263680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.271788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ab5ab-d64b-4960-8329-cd1a93de807d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.293261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b580a-8a5d-49f0-96b8-c469cb7b44bc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.310688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.319511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.320611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.321057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.321491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.325276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.327141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.330220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 205/406] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:47 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:47.331499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.344869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.347436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.348549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.349083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.351298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.353448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.356023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 202/407] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:47 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:47.357383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.457764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c27e5a-0e06-456c-b430-978644ac51a5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.466001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea6a7-c4a2-46e7-9a19-6ef04594f51b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.494337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.495094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.495439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.495723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.503057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.503829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.504150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.504426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/groups/d521cb24d07a4e7fae16d6807749b90e/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.506600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:47.506729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2b28c39a4f84b04afb3d148e7fc7, group_id=d521cb24d07a4e7fae16d6807749b90e, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.508109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:47.512614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:47.513787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:47.514626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 206/408] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:47.515264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.528437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 203/409] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 29 04:29:47 2022] PUT /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/groups/d521cb24d07a4e7fae16d6807749b90e/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:47.529285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.580493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.634031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.677359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c972522-f0dd-4190-9604-b97876827bed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.731668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.732324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.732618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.733014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.734225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.736089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.737924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 207/410] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:47 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:47.744762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.763335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7030ae3-31a8-41ee-93ba-50d851d602e5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.804060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.804918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.805394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.805868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.806715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:47.807156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.808707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.819719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 204/411] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:47.830671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:47.853958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.865452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1253c-3acc-4cac-a5bd-8fc815483b1e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.933557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:47.934200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:47.934499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:47.934782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/groups/d521cb24d07a4e7fae16d6807749b90e/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:47.941674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2b28c39a4f84b04afb3d148e7fc7, group_id=d521cb24d07a4e7fae16d6807749b90e, role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:47.941674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:47.955807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127cd50-e85d-4172-bfa8-84a1ac18e19f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:47.957980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:47.980797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 208/412] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 29 04:29:47 2022] PUT /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7/groups/d521cb24d07a4e7fae16d6807749b90e/roles/95d5a16009d54ef398e385695bf7abcd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:48.035950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:48.036637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:48.036923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:48.037204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] PATH_INFO: `/v3/groups/1b36acb257c646f5a84fa4c726ab64bc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:48.042768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] RBAC: Authorizing `identity:get_group(group_id=1b36acb257c646f5a84fa4c726ab64bc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:48.044305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:48.046128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 205/413] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:47 2022] GET /identity/v3/groups/1b36acb257c646f5a84fa4c726ab64bc => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:48.054754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:48.194773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f007d-1d9a-428f-b19b-cb3e9b2288a4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:48.230431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c299-dae5-41b6-86af-9a707b4d7b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:48.231082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c299-dae5-41b6-86af-9a707b4d7b27 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:48.231364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c299-dae5-41b6-86af-9a707b4d7b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:48.231641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c299-dae5-41b6-86af-9a707b4d7b27 None admin] PATH_INFO: `/v3/projects/c3845060db6a456e8e10c94484cbc67c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:48.232813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c299-dae5-41b6-86af-9a707b4d7b27 None admin] RBAC: Authorizing `identity:get_project(project_id=c3845060db6a456e8e10c94484cbc67c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:48.234287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c299-dae5-41b6-86af-9a707b4d7b27 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:48.236245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 209/414] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:48 2022] GET /identity/v3/projects/c3845060db6a456e8e10c94484cbc67c => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:48.242319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:48.411857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e6b81-8d48-4fbd-a55d-669c8ce7f08d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:48.464224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbd90f-dae7-48ad-b4d7-d420d9b7e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:48.464825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd90f-dae7-48ad-b4d7-d420d9b7e124 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:48.465111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd90f-dae7-48ad-b4d7-d420d9b7e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:48.465389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd90f-dae7-48ad-b4d7-d420d9b7e124 None admin] PATH_INFO: `/v3/projects/c3845060db6a456e8e10c94484cbc67c/groups/1b36acb257c646f5a84fa4c726ab64bc/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:48.467415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd90f-dae7-48ad-b4d7-d420d9b7e124 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3845060db6a456e8e10c94484cbc67c, group_id=1b36acb257c646f5a84fa4c726ab64bc, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:48.468863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd90f-dae7-48ad-b4d7-d420d9b7e124 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:48.497291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 206/415] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 29 04:29:48 2022] PUT /identity/v3/projects/c3845060db6a456e8e10c94484cbc67c/groups/1b36acb257c646f5a84fa4c726ab64bc/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:29:48.912278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d02488-acdf-4996-8243-2dc7a203a315 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:48.912653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d02488-acdf-4996-8243-2dc7a203a315 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:48.912854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d02488-acdf-4996-8243-2dc7a203a315 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:48.914430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 210/416] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:48.919970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:48.920266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:48.920546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:48.947296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:48.948502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:48.982380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:49.013186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1914e2-b119-4667-87da-641385b61ede None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.013838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1914e2-b119-4667-87da-641385b61ede None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.014345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1914e2-b119-4667-87da-641385b61ede None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.016113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 211/417] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:49.029200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 207/418] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:49.030693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.030981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.031286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.053859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:49.070586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:49.071960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:49.107054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:49.203541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8699603-5f1a-42b1-8658-9a5b00326a2f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:49.211807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 212/419] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:49.234278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:49.252760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:49.253471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.254291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.254576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.272812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:49.278835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:49.279711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:49.280499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:49.281160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 208/420] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:49.287850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:49.329655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:49.419768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9d0f6-dc9d-4c10-9c3d-cf2152c9ff9a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:49.429196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b86d7-523a-4d51-8cc7-aad82d961eaf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:49.475256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:49.475802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.476080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.476355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.477075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] RBAC: Adding query filter params (name=member) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:49.477380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:49.478793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:49.493191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:49.493858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.494142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.494411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.498476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 209/421] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:49.502799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:49.518133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:49.523655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:49.525874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:49.527877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 213/422] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:49.532468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:49.557510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:49.647738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:49.680433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb84f1-9c47-4c49-bc4a-420c134ff89e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:49.719859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe26f9-e4f0-4fd6-9696-eab2e5867e52 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:49.741004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957151c7-b448-416c-af0c-9034ea634d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:49.741641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957151c7-b448-416c-af0c-9034ea634d6f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.741927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957151c7-b448-416c-af0c-9034ea634d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.742268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957151c7-b448-416c-af0c-9034ea634d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.782223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:49.782841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:49.783117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:49.783387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:49.784093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:49.784394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:49.785845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:49.799870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 214/423] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:49.808447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:49.861154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957151c7-b448-416c-af0c-9034ea634d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:49.862626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957151c7-b448-416c-af0c-9034ea634d6f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:49.948323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:49.992611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bb922-9eb9-4e9b-8696-cd7980dc4eec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.015283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.035687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.036310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.036613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.036861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.041238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 210/424] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:50.042929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d098c-4f9f-4d81-bf32-c7c4c21c5b07 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.043308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d098c-4f9f-4d81-bf32-c7c4c21c5b07 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.043654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d098c-4f9f-4d81-bf32-c7c4c21c5b07 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.045268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 211/425] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:50.049925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d098c-4f9f-4d81-bf32-c7c4c21c5b07 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.123042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.125573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.161417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d098c-4f9f-4d81-bf32-c7c4c21c5b07 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.198370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46de25-6327-4323-b50d-da5a9701e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.199218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46de25-6327-4323-b50d-da5a9701e59b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.199586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46de25-6327-4323-b50d-da5a9701e59b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.199930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46de25-6327-4323-b50d-da5a9701e59b None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.201287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46de25-6327-4323-b50d-da5a9701e59b None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.202938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46de25-6327-4323-b50d-da5a9701e59b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.209642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 212/426] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:50.209642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.209642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.209642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.222227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.227831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:50.229123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:50.272448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 215/427] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:50.273676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.287854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.313527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 213/428] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:50.314615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.389481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df51c13-9c42-46cf-9909-b9f38edf0b4d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.423788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1607f37-eacf-44f8-bf50-2e9322fd6460 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.426481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819a068-8d1e-48ba-b8c5-1ab1f92dec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.427127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a068-8d1e-48ba-b8c5-1ab1f92dec44 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.427406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a068-8d1e-48ba-b8c5-1ab1f92dec44 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.427680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819a068-8d1e-48ba-b8c5-1ab1f92dec44 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.428824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819a068-8d1e-48ba-b8c5-1ab1f92dec44 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.430299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819a068-8d1e-48ba-b8c5-1ab1f92dec44 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.436738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 216/429] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:50.436738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc716a-84bc-4c65-9f96-5ecfc523ee97 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.436738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc716a-84bc-4c65-9f96-5ecfc523ee97 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.436738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc716a-84bc-4c65-9f96-5ecfc523ee97 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.436738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 217/430] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:50.436738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc716a-84bc-4c65-9f96-5ecfc523ee97 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.477188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.477974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.478330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.478676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] PATH_INFO: `/v3/projects/404edea2367442d9aae1754fdc0c7db5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.479945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] RBAC: Authorizing `identity:get_project(project_id=404edea2367442d9aae1754fdc0c7db5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.481460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.483424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 214/431] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/projects/404edea2367442d9aae1754fdc0c7db5 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:50.486117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.488713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.542657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.549813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc716a-84bc-4c65-9f96-5ecfc523ee97 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.584580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b140b25-afd4-4c3c-a361-31d240859856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.585283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b140b25-afd4-4c3c-a361-31d240859856 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.585578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b140b25-afd4-4c3c-a361-31d240859856 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.585888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b140b25-afd4-4c3c-a361-31d240859856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.596486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b140b25-afd4-4c3c-a361-31d240859856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:50.598168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debaf88e-1aee-4844-b22e-ccd7667c8238 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3b140b25-afd4-4c3c-a361-31d240859856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:50.601550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:50.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:50.603401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 218/432] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:50.604080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73084-b4e6-4909-a976-1360128659ef None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.604218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73084-b4e6-4909-a976-1360128659ef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.604498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73084-b4e6-4909-a976-1360128659ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.623304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-97f73084-b4e6-4909-a976-1360128659ef None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:50.624497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97f73084-b4e6-4909-a976-1360128659ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:50.639377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.639994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.640273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.640548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.641333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=404edea2367442d9aae1754fdc0c7db5) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:50.641743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.643091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.653744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 215/433] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=696d13ce411c44db98ea6d86268618d9 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:50.653744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.722437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 219/434] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:50.724076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f73084-b4e6-4909-a976-1360128659ef None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.757025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.794011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23913330-97a6-422c-8530-bc2a7bda037e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.813387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:50.845728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.846683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.847106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.848108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.848515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f73084-b4e6-4909-a976-1360128659ef None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:50.849810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.851720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.853682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 216/435] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:50.854650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.900079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:50.901200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:50.901756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:50.902032 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:50.902748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:50.903051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:50.904933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:50.923055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 220/436] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:50.923983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:50.988732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098ca1-2645-4b6e-b939-76a7486edd27 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.034378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.035736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.035736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.035736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.046892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:51.051194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:51.052621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:51.053506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:51.054379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 217/437] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:51.055066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.061629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcaff5-dc97-4607-9f30-268229c54435 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.102130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.102883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.103010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.103285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.104075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=404edea2367442d9aae1754fdc0c7db5) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:51.104386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.106141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d889592-46be-435c-96b4-54a92b9016aa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.108918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.112629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 221/438] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:50 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=404edea2367442d9aae1754fdc0c7db5&role.id=95d5a16009d54ef398e385695bf7abcd => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:51.114550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3f0d-affe-4fb4-a773-5cd90899faa3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.114985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3f0d-affe-4fb4-a773-5cd90899faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.115263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3f0d-affe-4fb4-a773-5cd90899faa3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.116570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 222/439] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:51.121653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3f0d-affe-4fb4-a773-5cd90899faa3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.200517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d7758-c370-4ab5-b709-59c1391a64ec None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.240751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.241379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.241688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.241966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.251069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3f0d-affe-4fb4-a773-5cd90899faa3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.293712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.294337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.294627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.294903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.295750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:51.295994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.297480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435629-3c8a-4004-94fe-2a984735ea83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.305819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 223/440] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:51.311619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.311921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.312207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.327517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.329566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.330429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:51.332493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:51.350058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.380147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.424113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 224/441] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:51.427039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.456788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 218/442] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:51.461775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.549055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c0ea1-294d-4500-8000-6aeca2c2a0d0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.571121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465d16b-f897-4814-84c7-24d89747ebb3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.582418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.583037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.583323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.583607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.600980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.604956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.605550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.605864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.606151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.614331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.619757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:51.624740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:51.625782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:29:51.626612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:51.630859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 219/443] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:51.631520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.653196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.654790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.731360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751515c2-6450-4c7c-9fd9-a343649d8ee9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.756477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 225/444] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:51.757217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.770742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.771375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.771661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.771937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.773095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.774647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.776290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 220/445] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:51.777050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.808179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.847130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:51.864742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1f4f9-6503-4d78-a0a9-3f18b673dbdb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.881675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7110515-b846-4e54-b180-c4c6b0b47baa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:51.897995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.898609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.898887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.899161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.899859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:51.900162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.901541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.909452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 226/446] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:51.910270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:51.914979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:51.915795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:51.916080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:51.916612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] PATH_INFO: `/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:51.917796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] RBAC: Authorizing `identity:get_project(project_id=66ce2b28c39a4f84b04afb3d148e7fc7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:51.919245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:51.920893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 221/447] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/projects/66ce2b28c39a4f84b04afb3d148e7fc7 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:51.921663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.014553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2419d8-4ace-4da2-a8f1-be5afe1088d8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.022715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f605-2e8a-40e4-8958-8d554bf087f2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.026073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:52.050073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.050753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.051039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.051319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.052548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.054074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.055838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 227/448] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:52.056385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.056493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.057084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.057328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.057635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.061881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:52.125818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.127310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.153908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a042e-cc2b-4f5e-bc46-648f8aa397c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.187740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.188370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.188650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.188924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] PATH_INFO: `/v3/groups/d521cb24d07a4e7fae16d6807749b90e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.190089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] RBAC: Authorizing `identity:get_group(group_id=d521cb24d07a4e7fae16d6807749b90e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.191543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.193109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 228/449] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:52 2022] GET /identity/v3/groups/d521cb24d07a4e7fae16d6807749b90e => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:52.193877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.229348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 222/450] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:29:52.230217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.241142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:52.263459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:52.296500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f45cd-6515-461a-8185-8a7adb4b429d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.327803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da147-a3d4-4fc4-a662-2625e0a7dad6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.329809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.330435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.330722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.331001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.331786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=696d13ce411c44db98ea6d86268618d9, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:52.332154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.333582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.339328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 229/451] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:52 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=696d13ce411c44db98ea6d86268618d9 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:52.340096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.370495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.371256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.371549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.371838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.372663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] RBAC: Adding query filter params (group.id=d521cb24d07a4e7fae16d6807749b90e, role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:52.372978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.374512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.393631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 223/452] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:52 2022] GET /identity/v3/role_assignments?group.id=d521cb24d07a4e7fae16d6807749b90e&scope.project.id=66ce2b28c39a4f84b04afb3d148e7fc7&role.id=95d5a16009d54ef398e385695bf7abcd => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:52.458994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7d9ea-bea0-420d-a522-9a289700f5d2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.471504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:52.499894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.500561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.500847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.501130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] PATH_INFO: `/v3/projects/c3845060db6a456e8e10c94484cbc67c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.502384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] RBAC: Authorizing `identity:get_project(project_id=c3845060db6a456e8e10c94484cbc67c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.503973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.506078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 230/453] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:29:52 2022] GET /identity/v3/projects/c3845060db6a456e8e10c94484cbc67c => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:52.511471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.623548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:52.627766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09df254-bf99-4ec0-9627-8fcff78b25cb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.662757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd242993-c84a-4b6b-87e9-675b48a14192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.663391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd242993-c84a-4b6b-87e9-675b48a14192 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.663675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd242993-c84a-4b6b-87e9-675b48a14192 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.663955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd242993-c84a-4b6b-87e9-675b48a14192 None admin] PATH_INFO: `/v3/groups/1b36acb257c646f5a84fa4c726ab64bc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.665098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd242993-c84a-4b6b-87e9-675b48a14192 None admin] RBAC: Authorizing `identity:get_group(group_id=1b36acb257c646f5a84fa4c726ab64bc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.666842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd242993-c84a-4b6b-87e9-675b48a14192 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.668423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 224/454] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 29 04:29:52 2022] GET /identity/v3/groups/1b36acb257c646f5a84fa4c726ab64bc => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:52.674646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:52.777324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7969-21a6-4f33-b768-5129aef8c219 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:52.812973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:52.813609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:52.813906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:52.814177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:52.814967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] RBAC: Adding query filter params (group.id=1b36acb257c646f5a84fa4c726ab64bc, role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=c3845060db6a456e8e10c94484cbc67c) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:52.815278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:52.817237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6e83-7305-4314-9a76-f75cb2f1c8c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:52.823113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 231/455] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 29 04:29:52 2022] GET /identity/v3/role_assignments?group.id=1b36acb257c646f5a84fa4c726ab64bc&scope.project.id=c3845060db6a456e8e10c94484cbc67c&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:55.218817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311192-ed89-4ef1-97e9-4c99157701bf None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.219300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311192-ed89-4ef1-97e9-4c99157701bf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.219300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311192-ed89-4ef1-97e9-4c99157701bf None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.220857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 225/456] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:55.226883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47c474-1e58-447a-824f-fb26e77e76bb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.227304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47c474-1e58-447a-824f-fb26e77e76bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.227446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47c474-1e58-447a-824f-fb26e77e76bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.254638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-df47c474-1e58-447a-824f-fb26e77e76bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:55.255842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-df47c474-1e58-447a-824f-fb26e77e76bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:55.303405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:55.351804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 232/457] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:55.395415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311192-ed89-4ef1-97e9-4c99157701bf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:55.413012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f15da-c2eb-40f2-9eb7-cf8da4643cba None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.413308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f15da-c2eb-40f2-9eb7-cf8da4643cba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.413614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f15da-c2eb-40f2-9eb7-cf8da4643cba None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.415078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 233/458] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:55.422310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.422611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.422886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.444277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:55.446142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:55.570771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311192-ed89-4ef1-97e9-4c99157701bf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:55.573470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 234/459] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:29:55.623779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:55.624430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.624859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.625135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.637200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:55.638692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:29:55.660507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:55.661434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:55.662280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:29:55.662280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:29:55.662280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:55.662280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:55.666110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 226/460] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:55.668019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:55.677704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:55.708254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:55.820210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaeb98-28b5-4732-8e37-7257f4ef88f3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:55.821922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:55.824360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f05069-cc43-4c88-823f-baffa903e05f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:55.864116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:55.864738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.865023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.865301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.866025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:55.866325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:55.866445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:55.866966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.867250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.867525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.867698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f29d3-4b6e-49c1-baa0-c0b65a55c323 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:55.879044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:55.880504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:55.887252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 227/461] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:55.889076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621de5-07ab-4b41-8574-de0976bbb440 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.889356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621de5-07ab-4b41-8574-de0976bbb440 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.889652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621de5-07ab-4b41-8574-de0976bbb440 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.897645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 228/462] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:55.897645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279e55-3698-4241-a6f9-97958eb11983 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.897645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279e55-3698-4241-a6f9-97958eb11983 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.897645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279e55-3698-4241-a6f9-97958eb11983 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.897645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 229/463] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:55.897645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3279e55-3698-4241-a6f9-97958eb11983 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b4326f1b-c970-47f4-a9b9-3f7679b7969b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:29:55.909015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:55.910399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:55.911235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:29:55.911235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:29:55.911235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:55.911235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:55.911437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 235/464] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:55.912787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af8253-4671-456a-9586-f5159d7650b7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:55.913081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af8253-4671-456a-9586-f5159d7650b7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:55.913364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af8253-4671-456a-9586-f5159d7650b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:55.933336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-51af8253-4671-456a-9586-f5159d7650b7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:55.934659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-51af8253-4671-456a-9586-f5159d7650b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:56.002883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:56.007786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 236/465] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:56.008871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.009185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.009467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.027498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:56.028823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:56.036836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3279e55-3698-4241-a6f9-97958eb11983 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.072813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.073356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.073670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.073953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.074636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.076068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.100711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 230/466] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:55 2022] POST /identity/v3/users => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:56.101533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.103040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 237/467] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:56.104137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.134114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:56.255068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff60a2-46a0-4896-8d4c-7d5b83165c8e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.255794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49b522-9305-4851-b553-bdcf1b70a191 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.295553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.296238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.297058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.297058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.298567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.299184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.299467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.299744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.300962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:56.301285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.302685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.305204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:56.312700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.314274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.317866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 231/468] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:56.322371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:29:56.331457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:56.332357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:56.333188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:29:56.333188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:29:56.333188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:56.333188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:56.333188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 238/469] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:56.333459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.418169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:56.447660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b59183-6371-4bef-aa37-9281953500dc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.458229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d19a84-039b-4cc2-acad-e4f4a4ee3743 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.487884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.489065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.489351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.489725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.490596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.492095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.502040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.502886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.503354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.504445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.516030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.516388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 239/470] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:56 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:56.521627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.523034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:29:56.552437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:56.553341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:56.554239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:29:56.554239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:29:56.554239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:56.554239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:56.555878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 232/471] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:56.568391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.648656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:56.671097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ed4b3-d11d-4064-acbc-6442d8ea95ab None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.704501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:56.716016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c17ff-0772-46b4-9d99-55eb50793270 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.722132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.722132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.723045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.724483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.724483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:56.724483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.726060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72c24b-e26e-4588-b8ed-61f797a50560 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.740251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 240/472] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:56.741858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb7ba-d14b-4c02-954c-d779fffe033c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.742406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb7ba-d14b-4c02-954c-d779fffe033c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.742685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb7ba-d14b-4c02-954c-d779fffe033c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.744117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 241/473] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:56.748760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbb7ba-d14b-4c02-954c-d779fffe033c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.768445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.769052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.769402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.769705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.771191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:56.771523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.773231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bea56e-80f3-48c8-80fd-9141bb23a390 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.788685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 233/474] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:56.795451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.795451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.795451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.818991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:56.820315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:56.871429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbb7ba-d14b-4c02-954c-d779fffe033c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:56.906286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 234/475] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:56.913774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:56.924589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:56.925654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:56.926312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:56.926796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:56.927728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:56.929644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:56.962663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 242/476] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:56 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:56.963496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:57.013620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:57.062078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:57.159385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7a0ef-cccc-49a2-86c9-3297dbb383d5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:57.166023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211f0e6-72f8-4e90-b1d6-f01810e92372 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:57.203918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:57.204630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:57.204916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:57.205191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:57.205993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:57.208248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:57.208552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:57.209404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:57.209973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:57.210448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:57.211356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:57.212923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:57.222047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.sql.core [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 04:29:57.222047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 29 04:29:57.222047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [parameters: {'id': 'dc5ba10fd2784fa69701f9b334e682a2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 29 04:29:57.222047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 04:29:57.235426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 235/477] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:29:56 2022] POST /identity/v3/users => generated 249 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Jul 29 04:29:57.240813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return ref.to_dict() Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 04:29:57.241768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application yield resource Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise self.value Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application session.commit() Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 04:29:57.242665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.flush() Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application compat.raise_( Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 04:29:57.243622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 04:29:57.244469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 04:29:57.245265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [parameters: {'id': 'dc5ba10fd2784fa69701f9b334e682a2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:57.246059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 29 04:29:57.246823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:57.249072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 243/478] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 29 04:29:56 2022] POST /identity/v3/roles => generated 144 bytes in 279 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:57.250351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:57.367287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034e25-cec1-4592-9f39-9cedb6f047eb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:57.369972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:57.409519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570284-4b5e-4464-b5d8-d4e9efa53cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:57.410996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570284-4b5e-4464-b5d8-d4e9efa53cad None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:57.411420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570284-4b5e-4464-b5d8-d4e9efa53cad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:57.411851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570284-4b5e-4464-b5d8-d4e9efa53cad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:57.423331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570284-4b5e-4464-b5d8-d4e9efa53cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-47570284-4b5e-4464-b5d8-d4e9efa53cad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:57.429687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:57.430559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:57.431352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 236/479] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:29:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:57.438418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:57.563203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ba2dc-1ed6-4382-a334-25c61853b4d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:57.564728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:57.602404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:57.603031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:57.603310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:57.603588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:57.604304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:57.604606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:57.606054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc6f0-ba09-4a39-a6d8-0ae18eb3887a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:57.614667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 244/480] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:29:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:58.415419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34b7f-6670-40ec-aaa7-7ac02d373a30 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:58.415931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34b7f-6670-40ec-aaa7-7ac02d373a30 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:58.416006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34b7f-6670-40ec-aaa7-7ac02d373a30 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:58.417867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 237/481] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:58.423043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:58.423335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:58.423615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:58.450583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:58.451789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:58.528911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 245/482] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:58.556536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca34b7f-6670-40ec-aaa7-7ac02d373a30 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:58.680454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca34b7f-6670-40ec-aaa7-7ac02d373a30 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:58.729076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:58.729756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:58.730096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:58.730373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:58.743774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:58.749303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:58.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:58.751013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 238/483] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:58.757646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:58.878931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:58.888155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea690-3fe4-4c2f-8708-508a0035d91b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:58.936744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:58.937368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:58.937678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:58.940769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:58.940769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:58.940769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:58.940769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e03aa6-cb59-4600-8a1d-9af7f3f5873d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:58.953627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 246/484] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:58.959894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:58.990943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:59.056127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5109-b26a-4596-a08e-1850f6c72dcb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.056473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5109-b26a-4596-a08e-1850f6c72dcb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.056696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5109-b26a-4596-a08e-1850f6c72dcb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.058334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 247/485] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:59.062916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751287d1-6cee-4004-b095-00031390625e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.063207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751287d1-6cee-4004-b095-00031390625e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.063493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751287d1-6cee-4004-b095-00031390625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.102550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-751287d1-6cee-4004-b095-00031390625e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:59.103754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-751287d1-6cee-4004-b095-00031390625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:59.106663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244ae72-f42a-4564-94a9-4c97c33d16f9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:59.150300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:59.151541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.152475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.153204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.175101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:59.178345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:29:59.205333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:59.206415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:59.207650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:29:59.207650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:29:59.207650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:29:59.207650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:59.210723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 239/486] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:59.217140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:59.241003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 248/487] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:29:59.268841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751287d1-6cee-4004-b095-00031390625e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:59.329440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:59.392519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70df9e-95b7-43fd-bdcc-0d08d720d847 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:59.438191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:59.461312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:59.461867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.462159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.462437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.463142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:59.463451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:59.464836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:59.477807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751287d1-6cee-4004-b095-00031390625e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:59.492066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 240/488] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:29:59.496941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:59.550878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:59.551528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.551810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.552085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.576648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:29:59.583980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:59.585097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:29:59.585957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 249/489] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:29:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:59.589258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:59.670807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3573115-c3bc-404b-87f6-3ec3e64c6ee3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:59.714141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:59.730346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:59.735219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.735948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.736527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.747355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:59.748849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-22f273b3-6068-4984-86e8-db109ddaf581 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:29:59.772649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:29:59.773587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:29:59.774500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:29:59.782080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 241/490] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:29:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:29:59.783407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594a1c-d2c7-45bd-b401-d74c5315c1a8 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.783699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594a1c-d2c7-45bd-b401-d74c5315c1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.783979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594a1c-d2c7-45bd-b401-d74c5315c1a8 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.792634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 242/491] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:29:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:29:59.793461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594a1c-d2c7-45bd-b401-d74c5315c1a8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:29:59.820711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23ea7-c937-4440-9be8-8c12c3a1ef9e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:59.874685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:59.875322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.875608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.875893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.876616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:59.876921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:59.878343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36dd25-6309-4f7d-8d94-3c333da830d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:29:59.888609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 250/492] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:29:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:29:59.893682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78c226-6702-40b4-b2db-cf390ed58fa4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.893682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78c226-6702-40b4-b2db-cf390ed58fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.893682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78c226-6702-40b4-b2db-cf390ed58fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.919941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8e78c226-6702-40b4-b2db-cf390ed58fa4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:29:59.921132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e78c226-6702-40b4-b2db-cf390ed58fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:29:59.923270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594a1c-d2c7-45bd-b401-d74c5315c1a8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:29:59.924682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:29:59.976050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:29:59.976596 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:29:59.976879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:29:59.977155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:29:59.978002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:29:59.978316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:29:59.980125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfdc31-4b5e-4893-9c2f-4ddbe2669fd8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.013632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 251/493] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:00.013632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f7b5-5bdf-4f75-ab4d-e4f1b65f8d31 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.013632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f7b5-5bdf-4f75-ab4d-e4f1b65f8d31 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.013632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f7b5-5bdf-4f75-ab4d-e4f1b65f8d31 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.013632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 252/494] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:00.013632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4f7b5-5bdf-4f75-ab4d-e4f1b65f8d31 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.029641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 243/495] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:29:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:00.029641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.029641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.029641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.048864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:00.050203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:00.108893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.167503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 244/496] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:00.168694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.209883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4f7b5-5bdf-4f75-ab4d-e4f1b65f8d31 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.251554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.252343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.252701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.253042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.261137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.265447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:00.268114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:00.284657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:00.286416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:00.287233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:00.287233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:00.287233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:00.287233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:00.287233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 253/497] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:00.287233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.307570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8454-c2df-4df7-81ea-b6cd33c09d60 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.345843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a00c-3e91-49b3-a9ff-0572f8bcd4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.346463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a00c-3e91-49b3-a9ff-0572f8bcd4bc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.346746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a00c-3e91-49b3-a9ff-0572f8bcd4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.347084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a00c-3e91-49b3-a9ff-0572f8bcd4bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.393824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.395865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eb1af-7a3b-4546-81e3-e346a4655e3a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.423368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a00c-3e91-49b3-a9ff-0572f8bcd4bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:00.424965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a00c-3e91-49b3-a9ff-0572f8bcd4bc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.431317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.432188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.432469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.432745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.445202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:00.450615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:00.451516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:00.452312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 254/498] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:00.452980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.502823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.539156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 245/499] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:00.540375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bffe8-10e5-45bf-9ee2-10e841353d04 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.540663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bffe8-10e5-45bf-9ee2-10e841353d04 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.540938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bffe8-10e5-45bf-9ee2-10e841353d04 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.542527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 246/500] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:00.543209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bffe8-10e5-45bf-9ee2-10e841353d04 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.561456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f344d97-eae4-4d96-bb3e-ec7e3c6c4c7e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.594107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.594745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.595025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.595297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.605647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:00.611010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:00.611940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:00.612702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 255/501] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:00.613970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.621867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.648881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bffe8-10e5-45bf-9ee2-10e841353d04 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.681838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.682447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.682727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.683001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.683682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:00.683985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:00.685354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.696644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 247/502] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:00.697589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.712129 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb49e-f934-4ff9-996b-0ab529fa4696 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.722316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.746198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.746820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.747107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.747380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.748091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:00.748400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:00.749815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5355c8-d506-4cae-b852-506b6c6ef72f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.758151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 256/503] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:00.759227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.759519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.759797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.776859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:00.778103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:00.801464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2d954-6358-4568-a59f-d822d44487cf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.833744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.834379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.834664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.834940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.836781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.843363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 257/504] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:00.844233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.853376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:00.854918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:00.870954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:00.871944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:00.872974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:00.872974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:00.872974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:00.872974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:00.872974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 248/505] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:00.872974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:00.949039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacef3fc-a689-46f8-b09c-0008ee1dd2ca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.950589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:00.974346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2fbe8-04b4-4a30-baad-b038b276c0ce None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:00.984403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:00.985018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:00.985296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:00.985574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:00.986294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:00.986597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:00.987982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:00.995698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 258/506] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:00.996477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.008074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.008788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.009004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.009293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.016709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.018177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:01.030378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:01.031451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 249/507] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:01.032325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.079150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.098081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ca73e-3079-479c-9c57-8c1cd55b45a2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.132207 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c16f-b175-4482-b4f6-2cf2ac39d92b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.132845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.133585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.133795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.134070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.145092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.146656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:01.161006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:01.162020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:01.163014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:01.163014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:01.163014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:01.163014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:01.163273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 259/508] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:01.164357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.167008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.167793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.168064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.168340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.181912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.183458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.185045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:01.200827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:01.201846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:01.202703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:01.202703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:01.202703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:01.202703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:01.202703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 250/509] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:01.202959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.274308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb3c5-68ef-433b-98e7-936538974a65 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.301577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.305232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885031c-cc76-4937-83c4-ada49161e658 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.309340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.309989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.310272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.310613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.311363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:01.311669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.313101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.325237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 260/510] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:01.326065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.343552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.344193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.344477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.344753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.358959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.360411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:01.379269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:01.380130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:01.380949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:01.380949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:01.380949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:01.380949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:01.380949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 251/511] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:01.381477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.411741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.436122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934538b-e62b-4624-bec6-2c72910b7b3d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.470717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.471343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.471629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.471907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.472698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:01.473007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.474488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.485585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dceb18-2e59-4108-9fb1-149446812cc5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.516023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 261/512] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:01.516863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.530201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.531053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.531495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.531773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.532462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:01.532772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.534185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.546155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 252/513] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:01.547037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.560976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.626729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa909f5-9e25-4c52-9961-3f0de5e0cc55 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.652701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa537127-90f3-4fe3-a139-2631778b8c90 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.661417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.662227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.662508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.662844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.663533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:01.663900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.665271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.666943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.678662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 262/514] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:01.679467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.692336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.693030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.693309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.693579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.701578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.705890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:01.718772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:01.719630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:01.720468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 253/515] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:01.720931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.781054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55fe46-e576-4ebf-894e-b9fa557987b4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.790515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.815767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.816503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.816791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.817095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.817822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:01.818240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.819628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.824532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828d147-86b9-4fdc-a48e-b5632d5b6055 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.852792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 263/516] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:01.853670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:01.862201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.862889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.863667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.863946 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:01.907209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:01.941797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:01.943271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:01.959973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f918009-f9c1-4464-bc2a-4eda0f1c17f3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:01.996520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:01.997155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:01.997431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:01.997738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.004639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.006139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.011426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:02.020883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:02.021848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:02.022734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 264/517] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:02.023714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.049546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 254/518] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:02.051265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.122786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f54ef-7795-4bf5-aea0-58eff5fa8586 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.136125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.147257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42536-dd39-43b5-af3f-e0e153aebc50 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.156710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.157325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.157617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.157916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.158593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.160123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.183182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 265/519] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:30:02 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:02.183980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.201413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.202097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.202391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.202669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.203446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:02.203761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.205257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.224863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 255/520] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:02.225803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.258826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.305341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51aef3-6376-4f64-a9c2-2c4590aa34d6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.333955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bdabf-2d09-4a86-86d0-1c1b746e162f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.347451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.348110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.348405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.348672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.357378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.358904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:02.371610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:02.372506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 04:30:02.373363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:02.373951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 266/521] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:02.374583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.378557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.380367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.380476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.380711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.381518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:02.381922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.383356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.403145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 256/522] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:02.404300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.414288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.489507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b684d-8e52-460f-8b87-b8e9d0fa7319 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.501620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.518215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338c84-4a3f-4767-8398-209e3bcf4649 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.528484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.529132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.529416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.529726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.542043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.543511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.555286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.556048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.556352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.556699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.557566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=2919227b992743178d0128981ad54c6b) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:02.557980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:02.558153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:02.558917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:02.564686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:02.564686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:02.564686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:02.564686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:02.564891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.564959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 267/523] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:02.564959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.568837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 257/524] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/role_assignments?user.id=2919227b992743178d0128981ad54c6b&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:02.577763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.679828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.700632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15d608-a927-40f5-981c-238c148ff6f2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.706063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e5c45-7e01-434d-a75d-ff7cd326323e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.746228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.747002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.747422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.747754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.751434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.752058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.752347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.752628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.754035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:02.754356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.755822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.773336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.775144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 268/525] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:02.776188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.832420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.833952 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.923311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b59f-b30a-454c-918c-ec52e5d3d57f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:02.951940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 258/526] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:02.953013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:02.967380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:02.968009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:02.968296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:02.968578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:02.969273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:02.969580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:02.970997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:02.979759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:02.984516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 269/527] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:02.985500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.015423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.071889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ba3fd-44c9-4c42-b523-75b05883624f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.100735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ee20-cb0c-4940-90f9-f306ebbb5d4e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.107214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.107833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.108173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.108754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.137818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.138717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.139148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.139589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.151487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.153120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:03.168263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:03.169306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:03.170309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:03.170309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:03.170309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:03.170309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:03.177313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 270/528] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:03.179019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.183299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.184824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.239758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.256166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.293795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 259/529] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:03.294650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.310085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378b37-4643-40a1-9ff8-83a26f9db201 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.347836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.348740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.349172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.349615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.357263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.358933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:03.372095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:03.373119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:03.374125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:03.376053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 271/530] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:03.376970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.405681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744029-c120-4bc3-aa94-07fffead424b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.441982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.442642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.442928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.443202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.444024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:03.444278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.445684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.461615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 260/531] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:03.461615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.473579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.489360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6b43-c6de-4a05-aeba-03c2e0fbb635 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.502811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.526702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.527857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.528564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.530013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.549122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.551460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:03.566784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:03.567821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:03.568731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:03.568731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:03.568731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:03.568731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:03.568946 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44603ad-5bf5-4cda-ac0f-9cd3bbe6943b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.570915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 272/532] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:03.571894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.603104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.603721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.604003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.604274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.605025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:03.605328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.606864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.624960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 261/533] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:03.625818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.682936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a218a-5548-4be5-9ef7-cd59b83eb392 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.701078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.719811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.720717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.721150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.721585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.729961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.731703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.738833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcf926-efcb-4ec4-b1f8-7efb7078d191 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:03.745338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:03.746440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:03.747410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:03.754098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 273/534] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:03.755143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.777113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.777811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.778142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.778420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.779149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:03.779458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.780911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.784141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.794895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 262/535] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:03.795795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.866517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972ba3b-38cc-4c34-9d10-515f07408780 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.901197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb90df4-0e97-4ba7-8e9c-e9a9dadff88d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:03.904131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.904958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.905389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.905840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.906783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=0dddbf2245fc4a71b91102e821f177ca) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:03.907256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.908830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:03.915837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 274/536] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/role_assignments?user.id=0dddbf2245fc4a71b91102e821f177ca&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:03.917051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:03.959118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:03.968680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:03.970122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:03.970661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:03.971080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:03.971978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:03.972996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:03.974609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:04.000227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 263/537] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:04.013974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.024446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:04.040135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccec786-54e2-4c9c-8ed9-1f9d7b2c0ab2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:04.077689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:04.078585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.079017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.079443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.089012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:04.090807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:04.104077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:04.105212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:04.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:04.108310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 275/538] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:04.118796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.168337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f016e5-78d8-4364-9eaf-a014789a889a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:04.204005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:04.204596 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.204883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.205159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.205986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=18adc9c4a6514351ba0d9df140578a73) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:04.206298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:04.207793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53678a6-1799-4965-91e2-5ae29b7c625f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:04.221786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 264/539] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/role_assignments?user.id=18adc9c4a6514351ba0d9df140578a73&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:04.271183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118f03-3907-43e8-bdec-39ee6bd898c4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.271535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118f03-3907-43e8-bdec-39ee6bd898c4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.271735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118f03-3907-43e8-bdec-39ee6bd898c4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.273445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 265/540] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:04.279770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.280202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.280583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.282021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10902916-4076-4b10-ac0f-29badc69a4b6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:04.307703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:04.309339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:04.353578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:04.354437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.354827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.355209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.356079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:04.356498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:04.358119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:04.405767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 276/541] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:04.409074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.417477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:04.423677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:04.441480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 266/542] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:04.464131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.574488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e41a-9d99-4151-9273-90a8a6279a9b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:04.619314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:04.619836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.620212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.620519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.640309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:04.651521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:04.652569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:04.653482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:04.658371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 267/543] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:04.662804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.679705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80b1c-2f7e-42a8-a4ea-6de93b074ab5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:04.729050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:04.734418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:04.735218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.735498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.735769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.736552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=56ea656c169243b9ac9319cb77bd4875) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:04.736859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:04.740007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1653d73-d03d-4932-90fc-4f03f029e3da None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:04.753942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 277/544] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/role_assignments?user.id=56ea656c169243b9ac9319cb77bd4875&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:04.753942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09076-e8ed-4c20-b863-b7a9d1f474bd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.753942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09076-e8ed-4c20-b863-b7a9d1f474bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.753942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09076-e8ed-4c20-b863-b7a9d1f474bd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.753942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 278/545] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:04.767750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.768082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.768407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.802858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:04.804317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:04.842605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2981558-7766-4cc8-87ae-83815e1476d0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:04.911348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:04.911988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:04.912325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:04.912609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:04.913355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:04.913678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:04.915096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:04.935352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 268/546] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:04.941479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 279/547] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 29 04:30:04.941990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.973798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:04.975731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:05.079234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773eb91-bb9a-458c-84c2-ff0be2fa5f2c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.118992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.120014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.120513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.120985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.130658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5683-db1c-46f9-b1f9-d39aa4f084ea None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.142622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:05.149430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:05.150334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:05.151203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:05.151990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:05.158074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 280/548] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:05.159227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:05.199816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.200399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.203794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.204087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.216912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:05.218899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:05.235993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:05.236847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:05.238899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:05.238899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:05.238899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:05.238899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:05.240763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 269/549] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:05.253725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:05.276010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:05.319518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e6f08-cec2-4eca-b72a-6b40d6bbaf13 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.355668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.356559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.356999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.357420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.358296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:05.358743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:05.360327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:05.374553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 281/550] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:05.376183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:05.460277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ff52-827f-4b9e-907f-6d572044264f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.485408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823156-cc94-4cc8-8eb8-5f51bdf5b05e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.511355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:05.530068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.531122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.531572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.531977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.544811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:05.547744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:05.551245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.552022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.552436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.552785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.553615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:05.554096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:05.562549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:05.566034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:05.567024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:05.568040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:05.568040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:05.568040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:05.568040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:05.574472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 282/551] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:05.578716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:05.595945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 270/552] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:05.602232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:05.631247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:05.731989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1adb6-0656-4fe6-bc16-a3bb75340db0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.799233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.799874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.800225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.800510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.801200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:05.801509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:05.802919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:05.834127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 283/553] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:05.849564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575515a8-aba3-42b1-b017-634f9fdbabd1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:05.849775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:05.910916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:05.911571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:05.911858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:05.912135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:05.930618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:05.931320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:05.934098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:05.963817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:05.964816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:05.966043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:05.967999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 271/554] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:05.974509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:06.125701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db282f-1610-431f-ac74-d709fc9f6c88 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:06.156348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:06.202198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f7bdd-4231-4676-b4c4-75baea2cd853 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:06.213812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:06.214521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.214808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.215126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.230902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:06.232376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:06.257623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:06.258659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:06.260055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:06.273863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 284/555] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:06.274957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:06.302617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:06.303309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.303812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.307120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.308553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:06.309698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:06.313396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:06.359576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 272/556] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 29 04:30:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:06.370157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:06.482800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:06.492515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf026a1-a396-41b9-83ab-f2575888ef5f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:06.540687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:06.542891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.543386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.544481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.545857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:06.547636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:06.549687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4a78-1dd3-4a07-a895-20908794a208 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:06.551534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7a67f-2907-41aa-bf44-3df6296c960b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:06.578873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 285/557] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:30:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:06.580444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb5d8-d44e-4699-9c46-9e4841847c07 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.580935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb5d8-d44e-4699-9c46-9e4841847c07 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.581519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb5d8-d44e-4699-9c46-9e4841847c07 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.582963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 286/558] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:06.588711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb5d8-d44e-4699-9c46-9e4841847c07 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:06.608812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11594b-c79f-46a7-8fb1-34c0966e3296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:06.610613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11594b-c79f-46a7-8fb1-34c0966e3296 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.611216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11594b-c79f-46a7-8fb1-34c0966e3296 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.611698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11594b-c79f-46a7-8fb1-34c0966e3296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.621033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:06.700437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11594b-c79f-46a7-8fb1-34c0966e3296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:06.702283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11594b-c79f-46a7-8fb1-34c0966e3296 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:06.721112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb5d8-d44e-4699-9c46-9e4841847c07 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:06.756480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:06.757079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.757351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.757581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.767747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:06.770424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cd22415a-eb95-48b0-940f-80e69f7bb739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:06.789418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:06.790393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:06.791267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:06.791267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:06.791267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:06.791267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:06.791267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 287/559] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:06.792662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.793056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.793431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.807167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:06.813273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:06.814503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:06.817450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 273/560] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:06.818698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167fa0-a0aa-448b-a406-ac3ecab3cb42 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.819062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167fa0-a0aa-448b-a406-ac3ecab3cb42 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.819411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167fa0-a0aa-448b-a406-ac3ecab3cb42 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.820856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 274/561] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:06.821504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167fa0-a0aa-448b-a406-ac3ecab3cb42 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:06.865737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:06.896773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 288/562] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:06.897803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:06.934402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167fa0-a0aa-448b-a406-ac3ecab3cb42 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:06.990996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:06.991650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:06.991933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:06.992214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:06.992950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:06.993256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:06.994689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258436-2bc5-463d-b826-f46c5b2b0899 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.009686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 275/563] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:07.010434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.010729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.011004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.028773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:07.029996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:07.034947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74a35-65b0-4062-83b5-0159fc5bc92e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.077278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.077973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.078260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.078543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.081348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.094982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.096555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.109876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 276/564] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:07.109876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:07.117087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:07.118041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:07.119102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:07.119102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:07.119102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:07.119102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:07.121424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 289/565] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:07.122859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.146417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.226371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a688921-5343-4a4b-9572-09936ee128e2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.236316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58fcfb-5f12-474a-9856-9d253ed96f35 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.261399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.262060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.262340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.262620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.269967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.270605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.270889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.271167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.272278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:07.277185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:07.278260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:07.279085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:07.279698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.279768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 277/566] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:07.279833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.279906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:07.294460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:07.295340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:07.296215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 290/567] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:07.297372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.354140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.373786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.386891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da06d5-51e7-4dcb-a687-7872ef68490d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.405850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4a6a5-badd-4184-a93a-c5ff61461933 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.422426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.423046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.423329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.423605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.424297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:07.424604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.426048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ef2f4-5854-41e8-9fc6-d238bdf24943 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.437716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 278/568] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:07.438699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b5d3-eff4-411f-92bf-b4aeecb0b6e2 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.438989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b5d3-eff4-411f-92bf-b4aeecb0b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.439270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b5d3-eff4-411f-92bf-b4aeecb0b6e2 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.440467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 279/569] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:07.441194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303b5d3-eff4-411f-92bf-b4aeecb0b6e2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.445556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.446244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.446530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.446808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.457529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:07.462918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:07.463994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 291/570] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:07.465127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.546929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303b5d3-eff4-411f-92bf-b4aeecb0b6e2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.564010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c8ca2-9b4b-4e12-9448-c38623452cd0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.573040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.580180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.580789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.581066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.581862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.582565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:07.582866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.584220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.591996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 280/571] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:07.592669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.602884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.603486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.603765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.604040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.604231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.604778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:07.605086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.606891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c75f9e-192a-4c0e-aa06-f9d158dfb703 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.620261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 292/572] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:07.622110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.622110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.622306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.641068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:07.642321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:07.697926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694702d-95b2-4997-a3eb-fa1581d0a8dd None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.707827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 293/573] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:07.721782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.732160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.732838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.733130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.733410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.740799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.742278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:07.753831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:07.754825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:07.755850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:07.759747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 281/574] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:07.760415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.821558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.826397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cc239-2295-412f-844d-7f40dbb8c828 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.828496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:07.861159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca5c63-15e9-4d25-9d29-695ccc3aad37 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:07.863323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210222e8-16be-4e74-9510-29480de22283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.864686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210222e8-16be-4e74-9510-29480de22283 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.864973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210222e8-16be-4e74-9510-29480de22283 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.865244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210222e8-16be-4e74-9510-29480de22283 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.866005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210222e8-16be-4e74-9510-29480de22283 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:07.866311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210222e8-16be-4e74-9510-29480de22283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.867668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210222e8-16be-4e74-9510-29480de22283 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.875501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 294/575] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:07.876268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210222e8-16be-4e74-9510-29480de22283 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.896147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:07.896779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:07.897065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:07.897345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:07.907895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:07.909335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:07.924276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:07.925196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:07.926312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:07.926312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:07.926312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:07.926312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:07.926312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 282/576] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:07.926911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:07.985962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210222e8-16be-4e74-9510-29480de22283 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.021202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.021902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.022186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.022462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/2919227b992743178d0128981ad54c6b/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.026096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328051c-c668-493d-a55e-fd1e3ebb2eea None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.036760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=2919227b992743178d0128981ad54c6b, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.038231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.049062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.053281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 295/577] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:07 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/2919227b992743178d0128981ad54c6b/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:08.054072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.067439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.069759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.070584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.070974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.071314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.084582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:08.090800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:08.091841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:08.092692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 283/578] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:08.093371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.175688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888acd-d05a-4fc5-802c-fd02f6fff245 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.217032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d9dc-c662-46f7-896c-c599d933c517 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.217228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.217793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.218077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.218353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.219106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:08.219423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.220866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.234219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 296/579] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:08.235381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.253361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.254180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.254543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.254888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.267910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.270588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:08.288959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:08.290054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:08.291020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:08.291020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:08.291020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:08.291020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:08.291020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 284/580] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:08.291020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.319893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.328595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.353538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3d929-4a18-4d3b-b211-4de7cd7b458c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.394744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.395443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.395797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.396146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.397128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:08.397240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.398708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.400071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c001e-126e-47f6-94f0-fda0f18384f9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.412938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 297/581] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:08.418835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.435133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.435742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.436022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.436298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.437004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:08.437307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.438701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.451018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 285/582] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:08.451018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.533490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81b1cf-9396-42cc-b2ac-25a0e9030590 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.551768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.560090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409ed87-1812-427c-8988-07b22d79bba9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.563900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.570731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.571341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.571619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.571886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.572658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=3cb7a5feda014624a86d87043526023d) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:08.572963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.574412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.580086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 298/583] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/role_assignments?user.id=3cb7a5feda014624a86d87043526023d&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:08.590966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.601081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.601776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.602064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.602337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.603055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:08.603364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.604861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.619363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 286/584] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:08.620242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.740596 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99aa5-67d0-4eb7-9c22-f3c82ed02a73 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.746137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44927e-8621-4bfd-8219-353ea54d1494 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.779109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.779753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.780037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.780318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.788932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.790003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.790430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.790865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.791676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.793441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.801829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.803464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:08.813398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:08.814340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:08.815212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:08.815212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:08.815212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:08.815212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:08.815212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 287/585] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:08.816760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:08.817274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:08.818367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 04:30:08.819498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:08.823305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 299/586] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:08.827502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:08.832183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.894142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:08.943909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d8b0-ee4d-4d4c-a1a2-b44221360db3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.945405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5547fd-c262-4377-85ee-aae2e42f24b1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:08.984737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.985639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.986159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.986469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:08.986885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.987110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:08.987397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:08.988200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:08.989031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:08.989540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.991450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:08.996827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:08.998291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.011421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 300/587] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:09.012532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:09.014186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:09.015105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:09.016026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:09.021704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 288/588] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:09.023598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.111409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.138423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878fb78-187a-4f7d-ba83-a5cea680975c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.147689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc8ecb-c8bd-4d05-ab36-72f58a292a89 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.162063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.177336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.178229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.178539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.178917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.185848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.186751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.187295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.187721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.188583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:09.189052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.190706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.192770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.194490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.203965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 301/589] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:09.205001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:09.216007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:09.217103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:09.218210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:09.218210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:09.218210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:09.218210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:09.224813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 289/590] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:09.224813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.353266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35c83-dc7c-487d-950c-1c502b3c7497 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.359018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9047ac-5cd3-42cc-b123-468c8710ce09 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.382330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.391894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.392761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.393247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.393772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.395050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:09.395654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.397757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.397866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.398503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.398858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.399208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.407221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.409086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.421334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 302/591] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:09.422289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:09.423363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 04:30:09.424513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:09.425581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.430844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 290/592] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:09.431797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.459731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.533294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39aa8-ce77-4c4b-b5d5-e845cc59ab35 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.542097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae7d62-abd7-418b-87f2-e9b1612d8933 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.571007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.571893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.572415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.572903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.573816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:09.574341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.575904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.583032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.583732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.584025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.584679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.594376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 303/593] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:09.595530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.595640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.597566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:09.612939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:09.613884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:09.614761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:09.614761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:09.614761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:09.614761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:09.614761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 291/594] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:09.615469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.648967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.697474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.708835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52eeb3-c372-42a2-8b00-e74d94f7431e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.730503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49653d-b4b9-4cc3-b001-2ff142fb4ef1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.756223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.757717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.758325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.758792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.760262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:09.760765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.762842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.768852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.769577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.769972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.770364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.782295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.783847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.786477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 304/595] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:09.787544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:09.802066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:09.803007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:09.803880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:09.808455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 292/596] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:09.809382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.911377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212f8a-2fc1-4456-ae36-123e3f5fc9eb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.919715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:09.931459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d9db4-84ef-4666-a866-b03613bc4a59 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:09.952573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.953516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.954053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.954564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.955474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:09.955985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.958119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.968981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:09.969688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:09.969990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:09.970476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:09.972226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 305/597] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:09.973274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:09.983846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:09.988223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:09.991851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:10.011487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:10.012611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:10.013803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:10.013803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:10.013803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:10.013803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:10.020469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 293/598] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:10.021465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.088594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240d8f-b6ee-472b-8ff5-3c50bbeedc20 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.125315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.125988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.126281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.126564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.127315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:10.127631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.129678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.142647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 306/599] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:10.143336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.163870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591fd6-73c8-41de-a58f-e4b2efea7d59 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.200989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.202536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.202536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.202536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.210654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.212212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.221272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e70fd1ff-6930-4673-ada5-f7a4f8a12f1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:10.224962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:10.226066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:10.227138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:10.230946 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 294/600] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:10.232206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f69f-b681-4878-848c-c2e2e47d845b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.232496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f69f-b681-4878-848c-c2e2e47d845b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.232776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f69f-b681-4878-848c-c2e2e47d845b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.234222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 295/601] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:10.238730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608f69f-b681-4878-848c-c2e2e47d845b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.244428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.260193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1f6c1-17c5-42a8-b028-104b27181352 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.298760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.299403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.299765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.300386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.300792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:10.301097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.302620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.317418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 307/602] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:10.318199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.358668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608f69f-b681-4878-848c-c2e2e47d845b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.392728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca901e-28d0-463c-a09a-501dc0cdea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.393399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca901e-28d0-463c-a09a-501dc0cdea62 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.394310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca901e-28d0-463c-a09a-501dc0cdea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.394609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca901e-28d0-463c-a09a-501dc0cdea62 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/0dddbf2245fc4a71b91102e821f177ca/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.410070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca901e-28d0-463c-a09a-501dc0cdea62 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=0dddbf2245fc4a71b91102e821f177ca, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.411527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca901e-28d0-463c-a09a-501dc0cdea62 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.427467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709353-8691-4e31-bd39-76ac6c768e21 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.428357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 296/603] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:10 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/0dddbf2245fc4a71b91102e821f177ca/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:10.429319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.429683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.429973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.450822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:10.452233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:10.480781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.495256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.496288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.496756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.497217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.498588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:10.500129 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.501875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.517197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.527902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 308/604] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:10.529285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.561629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 297/605] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:10.561629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.669621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485f4d-aba8-4575-8bdd-ebb4b9ae327e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.672810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743f26a-d9d5-45f1-939b-93dea566aab7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.708896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f3123-363e-47dc-8be4-8c4b00ccb069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.710232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3123-363e-47dc-8be4-8c4b00ccb069 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.710918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3123-363e-47dc-8be4-8c4b00ccb069 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.711338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3123-363e-47dc-8be4-8c4b00ccb069 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/18adc9c4a6514351ba0d9df140578a73/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.714576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:10.716047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.716342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.716623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.724517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.726668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.728655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f3123-363e-47dc-8be4-8c4b00ccb069 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=18adc9c4a6514351ba0d9df140578a73, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:10.730334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f3123-363e-47dc-8be4-8c4b00ccb069 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:10.742359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:10.743292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 309/606] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:10.745361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.748087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 298/607] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:10 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/18adc9c4a6514351ba0d9df140578a73/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:10.749434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554084c-1879-42e0-bc78-eb18a71c130c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:10.749702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554084c-1879-42e0-bc78-eb18a71c130c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:10.749979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554084c-1879-42e0-bc78-eb18a71c130c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:10.751447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 299/608] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:10.759191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554084c-1879-42e0-bc78-eb18a71c130c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:10.851556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.861818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:10.968052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba118e-e8ab-4553-84de-5e84475d47e7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:10.992032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554084c-1879-42e0-bc78-eb18a71c130c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:11.040532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:11.041785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:11.043583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:11.044813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:11.046358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:11.046987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:11.049636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fd519-7eb8-4a1c-a2e8-d2ec72f4f499 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:11.068350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 300/609] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:11.070871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:11.077624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:11.077624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:11.077624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:11.077624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:11.079923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:11.081859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:11.108344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:11.109717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:11.110399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:11.116405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:11.117462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:11.118479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:11.125190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 310/610] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:11.126159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:11.229716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 301/611] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:11.231869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:11.275880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:11.388828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b496e-98e2-454a-8b19-04dcd84d50e6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:11.439690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:11.441239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:11.441945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:11.442423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:11.443403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:11.444061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:11.447111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:11.461924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 302/612] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:11.463048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:11.474482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5c33-3512-4846-836e-41d14468c259 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:11.493996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:11.549776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:11.551388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:11.552734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:11.553236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/56ea656c169243b9ac9319cb77bd4875/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:11.611973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:11.623450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=56ea656c169243b9ac9319cb77bd4875, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:11.625635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:11.658364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 311/613] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:11 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/56ea656c169243b9ac9319cb77bd4875/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:11.666602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:11.678160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c690d4-bcdc-4ac7-9565-1d35369c3725 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:11.852383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:11.853874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:11.854407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:11.854917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:11.919179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:11.927675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:11.928552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:11.929362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:11.939438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 303/614] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 476 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:11.942929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.027286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea839f-cd05-400d-b8bd-86f271623655 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.118436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.119016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.119299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.119572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.130710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.132477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:12.156145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:12.157076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:12.157983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:12.157983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:12.157983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:12.157983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:12.158633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 312/615] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 499 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:12.166819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.196766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049834d-8f92-4cc9-b1b6-0af0b6aa86dc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.213625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:12.237062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.237773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.238136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.238453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.239340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:12.239686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.241085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:12.250280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 304/616] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:12.255936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.271797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:12.392729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96290246-4171-4fa7-ad16-d6dc7620cc94 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.436789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.439034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.439521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.439989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.441922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:12.445525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.447172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:12.473836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6160d-eb53-42f4-a315-30278d7fea90 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.474437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 313/617] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:12.477102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.522191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.523236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.524977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.525462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.566915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.568393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:12.598741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6e933d88-6305-4b02-bff2-7c648c52e25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:12.600593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:12.601434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:12.602405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:12.602405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:12.602405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:12.602405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:12.602405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 305/618] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:12.603313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616ab7-2bab-4b22-ad2c-b2f7797a10ce None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.603601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616ab7-2bab-4b22-ad2c-b2f7797a10ce None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.603877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616ab7-2bab-4b22-ad2c-b2f7797a10ce None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.608972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 306/619] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:12.609935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616ab7-2bab-4b22-ad2c-b2f7797a10ce None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.624144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fccd6-fe3a-475c-82dc-bc9492edddc2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.673138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.674357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.674642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.675440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.684297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:12.684540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.686061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f7c72bb9-230f-4ee7-9e40-b1b5479e70d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:12.700172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:12.701127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:12.702636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 314/620] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:30:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:12.703226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16927aa7-4115-4811-8ff6-4415086678da None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.703226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16927aa7-4115-4811-8ff6-4415086678da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.703361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16927aa7-4115-4811-8ff6-4415086678da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.722444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-16927aa7-4115-4811-8ff6-4415086678da None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:12.723642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-16927aa7-4115-4811-8ff6-4415086678da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:12.742351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616ab7-2bab-4b22-ad2c-b2f7797a10ce None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.785415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.786594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.787466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.787925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.788806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:12.789287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.791616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:12.807602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 307/622] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:12.808699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.811431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 315/622] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:12.814115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16927aa7-4115-4811-8ff6-4415086678da None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:12.892685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:12.949212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16927aa7-4115-4811-8ff6-4415086678da None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.949659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2edb00-0160-4376-96d7-e67a181a5155 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:12.973576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:12.992106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.992755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.993043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.993318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.993430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:12.994082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:12.994445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:12.994787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:12.995838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:12.996724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:12.998300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.000930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.002403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.016571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 308/623] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:30:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:13.017393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b100d730-8944-4a6b-a6f1-c9799521efbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:13.018328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:13.019277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:13.020205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:13.022286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 316/624] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:13.023601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f2f4-72a8-4edb-a26e-c0d572b4fa1e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.023944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f2f4-72a8-4edb-a26e-c0d572b4fa1e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.024269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f2f4-72a8-4edb-a26e-c0d572b4fa1e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.026987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 317/625] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:13.026987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f2f4-72a8-4edb-a26e-c0d572b4fa1e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.133912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1139f-ff6f-409a-888a-4e253baf1e56 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.139939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f2f4-72a8-4edb-a26e-c0d572b4fa1e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.160909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.173320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.174033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.174318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.174594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.176661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e815e0-8bd2-4a10-99ae-873745e19c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.177336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e815e0-8bd2-4a10-99ae-873745e19c7e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.177645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e815e0-8bd2-4a10-99ae-873745e19c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.177924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e815e0-8bd2-4a10-99ae-873745e19c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.185540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:13.191186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:13.192210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:13.193191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:13.202179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 309/626] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:13.202179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.243895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.255323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e815e0-8bd2-4a10-99ae-873745e19c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.256794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e815e0-8bd2-4a10-99ae-873745e19c7e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.316559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd52e52-89e8-4ec7-b8d6-f25af1f61353 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.353737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.354468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.354750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.355023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.355808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:13.356118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.357756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.375656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 318/627] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:13.375656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.375656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.375656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.380360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 310/628] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:13.381271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.395212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:13.396411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:13.411358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.469082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 319/629] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:13.470179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.497787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.506323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010e88-6cfa-4dd8-ad02-46213d30bfe8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.545941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.546566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.546848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.547122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.547833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:13.548137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.549504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.559147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 311/630] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:13.560171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.581883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b38612-49ea-44f6-9896-be9ed7a62a13 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.618872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.619502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.619781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.620052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.634459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.636118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:13.652302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:13.653268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:13.654226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:13.654226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:13.654226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:13.654226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:13.654226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 320/631] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:13.654226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.656993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.679389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c7995-4b78-48f9-b1a4-b9cec03097d4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.717314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.717985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.718294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.718545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.730080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.731503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:13.751082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:13.752028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:13.752972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:13.752972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:13.752972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:13.752972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:13.757161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 312/632] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:13.757960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.767889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4195ec8-1712-45a8-aaf7-ed122ebb6738 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.773082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.807125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.808023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.808305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.808581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.819390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:13.824698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:13.825811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:13.826637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 321/633] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:13.827339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.873019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52cc5-9891-4e15-87af-59f10b679267 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.894423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:13.909642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85252048-d74e-4095-9a62-8637405c251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.910292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85252048-d74e-4095-9a62-8637405c251d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.910577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85252048-d74e-4095-9a62-8637405c251d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.910854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85252048-d74e-4095-9a62-8637405c251d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.922979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85252048-d74e-4095-9a62-8637405c251d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.924425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85252048-d74e-4095-9a62-8637405c251d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-85252048-d74e-4095-9a62-8637405c251d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:13.941651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:13.942702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:13.943621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:13.943621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:13.943621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:13.943621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:13.949679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 313/634] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:13.949679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85252048-d74e-4095-9a62-8637405c251d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:13.950307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876ff6-18b1-4236-b7ca-0901f8cfde1a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:13.985925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:13.986551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:13.986838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:13.987113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:13.987871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:13.988177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:13.989546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.001089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 322/635] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.001913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.021767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.073356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85252048-d74e-4095-9a62-8637405c251d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.108101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.108716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575003d8-c238-4c95-a3a0-2949a2c0ca00 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.108846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.109000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.109280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.111000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:14.111310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.113243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.124957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 314/636] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.125783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.132397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.145173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.145799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.146089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.146364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.147079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:14.147371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.148726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.156712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 323/637] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.157476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.225623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d1dd-c206-4614-a42a-ab303ae0a879 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.247842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.260608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.261168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b0327-12a9-4ee2-937f-d55854de4333 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.261283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.261500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.261819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.262511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:14.262823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.264197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c0f6-da57-4475-9664-afa3cf214fcb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.276630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 315/638] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.277871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a7a88-5ff1-434f-8e7d-f21ede0c295a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.278172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a7a88-5ff1-434f-8e7d-f21ede0c295a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.278454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a7a88-5ff1-434f-8e7d-f21ede0c295a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.281734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 316/639] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:14.282513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a7a88-5ff1-434f-8e7d-f21ede0c295a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.298368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.299007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.299291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.299571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.307124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.308583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:14.321366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:14.322383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 324/640] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:14.323286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.369710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.387397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a7a88-5ff1-434f-8e7d-f21ede0c295a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.420556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.421190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.421475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.421780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.427566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a794-a501-4e1a-9bcb-9c460e400427 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.429139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.430623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:14.442541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:14.443613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:14.444485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 317/641] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:14.444961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.462795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.463434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.463712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.463984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.474225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.475646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.488445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8d5024fe-e2b8-4d6a-880a-5aba9fb97efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:14.491147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:14.492178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:14.493310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:14.493310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:14.493310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:14.493310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:14.493310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 325/642] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:14.493669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.493829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.494265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.512136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:14.513266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:14.546694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c43fd-edb8-44ba-a335-ea38c7ff4f71 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.579066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.579243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 326/643] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:14.579913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.580176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.580608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.581019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.590284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.591778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:14.603924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:14.605087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 318/644] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:14.606250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.613422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.685963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cd04-c47d-441b-aeb0-559b0656da48 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.708314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f9c9b-a73f-4df4-bcb0-c44bee43f775 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.709981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.720878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.721500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.722321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.722602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.723349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:14.723663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.725114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.736304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 327/645] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.737084 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.744641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.745258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.745540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.745843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.746585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:14.746894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.748318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.760566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 319/646] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.761324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.827103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:14.841699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504ed3f-ec76-447e-9d2e-6c3f6198eaca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.863534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e3d61-4895-4c05-b110-169fd7013454 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:14.876333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.876947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.877226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.877499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.878236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:14.878538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:14.879892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:14.891158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 328/647] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:14.891921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.898967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:14.899608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:14.899890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:14.900166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:14.911364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:14.917727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:14.918817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 320/648] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:14.920026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:14.947673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.000263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09770e-3f4a-4bbe-be2a-65f0600f7d09 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.025584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702fea0-660c-4659-818e-11a2f85bc7b1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.037181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.037866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.038153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.038433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.039218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:15.039526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.040965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.058271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 329/649] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:15.059031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.059155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.059802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.060024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.060300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.061086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=2919227b992743178d0128981ad54c6b) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:15.061401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.062884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.063902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.068786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 321/650] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:14 2022] GET /identity/v3/role_assignments?user.id=2919227b992743178d0128981ad54c6b&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:15.069559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.167322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.178570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d7ff-dd97-4b3c-8247-c84b7f0edb45 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.185362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2494461-56a8-4d0d-816b-38d52f1ce136 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.217189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.217988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.218183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.218468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/3cb7a5feda014624a86d87043526023d/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.222818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.223555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.223948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.224321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.236580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=3cb7a5feda014624a86d87043526023d, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.237831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.238364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.239287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:15.251948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:15.252967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:15.253962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 322/651] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:15.254640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.261531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 330/652] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:15 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/3cb7a5feda014624a86d87043526023d/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:15.271108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.344146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.382487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99084ab1-a272-4a39-b4c8-0be1f144cf85 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.420320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260eee-ef97-46d5-90a5-c04e99d7ce63 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.425455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.426259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.426637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.427017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.427843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:15.428306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.430397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.440006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 323/653] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:15.441483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.460640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.476974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.478118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.478118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.479484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.556597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.558236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.583860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c93ff-e623-4785-9773-5715c557f84b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.621168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.628882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.629725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.630338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.630785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.632098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:15.632839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.634681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.658262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 324/654] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:15.659736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.690751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 331/655] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:15.690751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.747265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.790855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ddd66-09b2-4170-80df-f3ea3e006590 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.803766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65809a-b046-4b9f-b8af-fe83e7ce21d2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:15.826440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.827318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.827749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.828171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.839383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.841028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.849694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:15.850436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:15.850823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:15.851201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:15.858401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:15.859423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:15.860484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:15.860484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:15.860484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:15.860484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:15.866721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 325/656] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:15.867805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:15.881055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:15.932620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:15.934501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:15.981437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63673c-deb2-4cec-af49-23cd28e052fa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.000921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.023546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.024443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.024874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.025294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.037066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.039168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.049173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 332/657] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:16.050202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:16.054825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:16.055857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:16.056915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:16.056915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:16.056915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:16.056915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:16.063100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 326/658] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:16.064107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.121461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.173385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c212-7d63-4528-ab7c-c15e6bfa453b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.182336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75c820-2c67-4b96-9382-c11c92e113b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.208996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.209889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.210319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.210761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.223448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.224628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.224628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.225005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.225891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:16.226298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.227935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.229059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.230722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.245362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 333/659] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:16.245362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:16.250301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:16.251316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:16.252387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:16.252387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:16.252387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:16.252387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:16.254731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 327/660] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:16.255700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.293263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.362689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580068-a469-495d-bfe4-bce157dfaabd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.378973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.397267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345658f6-f563-408f-a989-c77cbbc1cc4d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.402284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.402979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.403336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.403677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.404435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:16.404809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.406364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.419325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 334/661] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:16.420281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.455519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.456846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.457146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.457431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.468167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.470159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:16.484948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:16.486008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:16.486951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 328/662] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:16.488529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.553693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8467-2ad9-4d68-a4a4-ac88650ca9e5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.579476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.599326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a995-0b2b-46cd-86b5-3a925c613985 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.599791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.600634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.601289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.602637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.603512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:16.604019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.605558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.625484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 335/663] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:16.626800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.640375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.641129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.641484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.641858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.652459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.655663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:16.670447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:16.671344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:16.672377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 329/664] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:16.673033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.674943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.762544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c09a3-1c73-4896-a97f-c37a85ff97b7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.795347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2bfe1-b6b4-4d7d-ad59-8a2eb7382014 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:16.810505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.811720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.812199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.812905 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.814073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:16.814390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.816378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.836547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:16.836913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 336/665] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:16.837806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.838096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:16.838594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:16.839068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:16.848590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:16.851256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:16.867923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:16.868851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:16.869760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:16.877278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 330/666] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:16.877278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:16.881315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.954821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:16.965006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c43258-18fe-4b47-a85d-66aba514a2c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.006701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.007319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.007599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.007886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.008606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:17.008909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.010527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.023283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 337/667] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:17.024107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.029843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75b2bb-8b1e-4cdd-a18a-3b9c7aa9ba15 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.067899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.069418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.069946 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.070421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.145760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7bdf-caeb-4c44-b663-f3e5fd005bf2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.149092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.150902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.152957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:17.187646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.188319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.188542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.188873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.189639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:17.189991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.192985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.213018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 338/668] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:17.213018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.226779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:17.274430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 331/669] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:17.275272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.329293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3662-5bbf-4f32-be4b-defd6579ee83 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.365657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.366276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.366560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.366840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.367624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=0dddbf2245fc4a71b91102e821f177ca) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:17.367937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.369390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af846-04df-4961-8698-d4b89ee72df1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.375136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 339/670] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/role_assignments?user.id=0dddbf2245fc4a71b91102e821f177ca&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:17.376493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd927291-e65c-488b-9ccb-aab56c119e8f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.376778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd927291-e65c-488b-9ccb-aab56c119e8f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.377075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd927291-e65c-488b-9ccb-aab56c119e8f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.379167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 340/671] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:17.379904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd927291-e65c-488b-9ccb-aab56c119e8f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.380200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798127-c517-4936-b93a-e3bf279681d5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.381935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:17.423286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.423927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.424214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.424493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.426126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=18adc9c4a6514351ba0d9df140578a73) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:17.426448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.427948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1dffc-e1ea-4b9c-bde3-77fd2ffefe14 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.442876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 332/672] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/role_assignments?user.id=18adc9c4a6514351ba0d9df140578a73&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:17.442876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1741d-a406-46a9-95df-5fabc32577cd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.442876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1741d-a406-46a9-95df-5fabc32577cd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.442876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1741d-a406-46a9-95df-5fabc32577cd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.442876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 333/673] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:17.442876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3710e-9afe-421c-bac8-4b0e3d1c134a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.443523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3710e-9afe-421c-bac8-4b0e3d1c134a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.443953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3710e-9afe-421c-bac8-4b0e3d1c134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.471095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-17c3710e-9afe-421c-bac8-4b0e3d1c134a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:17.472638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17c3710e-9afe-421c-bac8-4b0e3d1c134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:17.492441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:17.528447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd927291-e65c-488b-9ccb-aab56c119e8f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.577766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 334/674] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:17.579184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997438d2-0457-4832-8605-7d302f57a940 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.579529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997438d2-0457-4832-8605-7d302f57a940 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.579754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997438d2-0457-4832-8605-7d302f57a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.586064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.586730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.587015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.587291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.605915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.607491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.608145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-997438d2-0457-4832-8605-7d302f57a940 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:17.609960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-997438d2-0457-4832-8605-7d302f57a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:17.625753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:17.627083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:17.628775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:17.628775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:17.628775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:17.628775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:17.628775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 341/675] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:17.628775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.704774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 335/676] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:17.706135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997438d2-0457-4832-8605-7d302f57a940 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.733185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:17.789715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780a033-ed98-4bef-a38c-e4ebd8c2b920 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.817564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997438d2-0457-4832-8605-7d302f57a940 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:17.828858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:17.840867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.841470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.842311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.842601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.857514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:17.857933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:17.858816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:17.859292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:17.859817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:17.860706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:17.863383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:17.863722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:17.864600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:17.865440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:17.868459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:17.869773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 342/677] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:17.870985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:17.885210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 336/678] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:17.887612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.003703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8333a-d662-4ff6-aaa6-d2bff7be06b9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.010099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:18.026867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d92862-3692-4e36-b097-94c2a4c2e5e8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.039797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.040447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.040749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.041012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.055756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:18.061440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:18.062564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:18.063500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 343/679] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:18.064178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.069414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.070646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.071093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.071514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.072376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:18.072882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.074676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.087532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 337/680] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:18.088694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.124139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:18.179508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e97b-677e-4822-9733-0532e2a159b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.212927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a285e9d-b5a9-4ebb-87cb-65ac5f3c1c32 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.223500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.224163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.224451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.224731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.234655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.236754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.251842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.253400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:18.253869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:18.254712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:18.255582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:18.256558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.257052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.258111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:18.258619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.259785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 344/681] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:18.260437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.260633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.271340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 338/682] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:18.273016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.290014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:18.404622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bed8-6942-4aac-80ca-e96b2a781fa6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.411254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb1434-a048-44bd-baf1-ac5ba35b3ac8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.419308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:18.455606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.456904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.457316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.457676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.460314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.461513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.462026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.462491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.463402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:18.463884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.466026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.470175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.471793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.481876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 339/683] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:18.482953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:18.501588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:18.502539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:18.503928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:18.503928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:18.503928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:18.503928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:18.510735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 345/684] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:18.512313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.574631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:18.606702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646db3-8b21-490c-a1b5-f51007a0a1d3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.653537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.655253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.655741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.656232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.656913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acdee2-7d5f-4af7-b13b-711ecbe9bcae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:18.672173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.673691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:18.691401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:18.692333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:18.693221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:18.693221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:18.693221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:18.693221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:18.693221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 340/685] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:18.694079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.705230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:18.705940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:18.706226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:18.706503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:18.707433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=56ea656c169243b9ac9319cb77bd4875) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:18.707749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:18.709411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:18.716217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 346/686] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/role_assignments?user.id=56ea656c169243b9ac9319cb77bd4875&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:18.717072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:18.763315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:18.952154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8749-c03a-427c-828d-f948ff01d0af None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.008034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.008666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.008949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.009224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.011341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:19.011341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.011630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.024530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a2ca-a897-46c2-88c1-d9bc33ec3cce None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.029047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 347/687] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:19.035011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:19.052899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:19.066561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.067573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.068139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.068660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.069555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:19.070526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.072146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.085664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 341/688] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:19.092382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:19.138484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:19.159296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48637ff-3750-4af0-9868-54fc9f581ac3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.227410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.228032 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.229636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.229636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.241620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.244176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:19.261976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:19.263027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:19.264110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 348/689] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:19.268121 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:19.283600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78d62-41a8-4e00-9e4e-59e232d15950 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.375336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1e649-6b3d-4ebd-bef6-bd331f010b48 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.408168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.409192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.409694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.410160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.411947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.412571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.412854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.413131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.413955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:19.414264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.415709 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.435795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 349/690] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 29 04:30:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:19.436842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.438445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.442095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:19.449069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:19.469148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:19.470297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:19.471215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:19.476124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 342/691] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:30:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:19.478066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:19.597190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce8901-535a-4592-be44-ff461be0c98c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.605085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:19.637379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed533c07-226e-4c3c-9c0d-4c2b2de67107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.638104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed533c07-226e-4c3c-9c0d-4c2b2de67107 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.638491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed533c07-226e-4c3c-9c0d-4c2b2de67107 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.638775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed533c07-226e-4c3c-9c0d-4c2b2de67107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.715588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2d21-cc42-422f-9c4f-d42f795d8525 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.717836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed533c07-226e-4c3c-9c0d-4c2b2de67107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.719329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed533c07-226e-4c3c-9c0d-4c2b2de67107 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.721192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:19.749997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.750634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.750921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.751193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.751986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:19.752294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:19.754312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb0f8-c14f-46c1-9602-2193627a5645 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:19.774431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 343/692] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:30:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:19.775746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2780b4-8d9f-46e2-a953-b2f4d11582a4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.776031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2780b4-8d9f-46e2-a953-b2f4d11582a4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.776335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2780b4-8d9f-46e2-a953-b2f4d11582a4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 344/693] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:19.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29335-170c-4220-855b-dd72813e09f5 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29335-170c-4220-855b-dd72813e09f5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb29335-170c-4220-855b-dd72813e09f5 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 345/694] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:19.782052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29335-170c-4220-855b-dd72813e09f5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:19.843910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 350/695] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 29 04:30:19.849859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b290-8237-46f6-a31e-532d7260d17c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.850150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b290-8237-46f6-a31e-532d7260d17c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.850430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b290-8237-46f6-a31e-532d7260d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.868151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4698b290-8237-46f6-a31e-532d7260d17c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:19.869322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4698b290-8237-46f6-a31e-532d7260d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:19.888149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:19.892437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb29335-170c-4220-855b-dd72813e09f5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:19.926569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:19.927177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.927458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.927731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.951121 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 351/696] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:19.952171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:19.952458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:19.952732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:19.970465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:19.971683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:20.002050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.012343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.013832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.047627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 352/697] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:20.048471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.127495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.136813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 346/698] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:20.136813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.165948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ec822-ed2c-4dd4-b54d-ba2f6f7c144d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.207495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.208288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.208668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.209040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.222127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.224261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:20.239990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:20.241491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:20.242574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:20.242574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:20.242574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:20.242574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:20.245763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 353/699] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:20.246458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.247446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ca9f3-e043-42a1-9da1-1ee4e9324429 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.263692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.285153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.285922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.286274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.286625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.300766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.302255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:20.317716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:20.318638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:20.319522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:20.319522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:20.319522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:20.319522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:20.319522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 347/700] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:20.319801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.365847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0314f-66a6-46a7-baea-75d913012ffc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.376251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.406141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.406786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.407070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.407347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.407970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.409494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:20.421843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:20.422837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:20.423667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 354/701] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:20.425453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.434283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed202a9-e136-4c78-85c6-ff33e199ceaf None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.469536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.470290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.470652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.471002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.481992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.483554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:20.499244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:20.500348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:20.501228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:20.501228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:20.501228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:20.501228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:20.501228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 348/702] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:20.501691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.521863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.546556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8b9ed-05c5-442b-97a9-ce0cf2cd00a8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.585192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.585941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.586326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.586713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.587482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:20.587990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.589343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.601841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 355/703] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:20.602712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.611034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511826e-c695-4bc9-a055-bf0065219f6a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.614624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.654496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.655290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.655666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.656037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.656827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:20.657227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.658718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.676880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 349/704] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:20.677862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.715350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e00fd0-017d-4ddc-88ca-45598b9fa4c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.751255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.752045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.752419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.753331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.754132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:20.754537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.756000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.760985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 356/705] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:20.766134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.769248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.788135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf7907-ce92-4b1c-897d-ca58224018c5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.825712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.826471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.826843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.827276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.828112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:20.828523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.830243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.847009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 350/706] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:20.847009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.870991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:20.883134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0848fa-5318-4a79-b2e4-79ab14808378 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.918226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.918968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.919326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.919680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.931257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:20.932215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:20.947397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:20.948354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:20.949204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 357/707] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:20.949760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:20.962212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d937-6190-4af4-bb21-fc8c9db1e441 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:20.997687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:20.998437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:20.998719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:20.998989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:20.999665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.001071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.016292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:21.024417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 351/708] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:30:20 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:21.025439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:21.077575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add66bd6-c6b4-466a-a43d-ab3b1e86aa6c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.117411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.118184 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.118477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.118752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.119436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:21.119742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.121131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.125740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:21.129999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 358/709] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 29 04:30:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:21.131446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:21.155696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32f246-e742-45c4-8ae4-f7638fb4ad1f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.208014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.208843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.209231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.209660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.219938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.221487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f4502376-56aa-41b6-baf2-86a044bfdad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:21.240228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:21.241199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:21.242145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 352/710] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:21.245343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6eb2-1e0b-49f1-8c13-e2665053a656 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.245656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6eb2-1e0b-49f1-8c13-e2665053a656 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.245939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6eb2-1e0b-49f1-8c13-e2665053a656 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.249029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 353/711] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:21.249956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb6eb2-1e0b-49f1-8c13-e2665053a656 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:21.321262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2942de-c9db-4fc3-ad51-08537a8db3ca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.353532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:21.368267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.369652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.370104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.370538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.371443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:21.372008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.374408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535c88-b06e-4c19-9ad9-d2d290da8503 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.392329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb6eb2-1e0b-49f1-8c13-e2665053a656 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.394261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 359/712] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:21.396637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.397116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.397621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.431271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.432106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.432458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.432799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.433663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:21.434095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.435635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.447457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:21.451745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 354/713] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:21.452838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:21.556754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:21.558116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:21.574064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94473-1034-4bb0-a019-c520990456d3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.622028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.623600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.624329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.624791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.626070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=3cb7a5feda014624a86d87043526023d) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:21.627082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.629852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.638830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 355/714] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/role_assignments?user.id=3cb7a5feda014624a86d87043526023d&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:21.645917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 360/715] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:21.645917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:21.667842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:21.781796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:21.868626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067bad-b4a9-49ed-9d54-894dad49a9ec None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.876339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a30800-260e-458e-bd8b-f0e7ffcb1690 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:21.892045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:21.914205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.914825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.915108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.915380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.916166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=2919227b992743178d0128981ad54c6b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:21.916889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.918959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.925756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 361/716] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/role_assignments?user.id=2919227b992743178d0128981ad54c6b&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:21.931092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:21.935016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:21.935531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:21.936045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] PATH_INFO: `/v3/services/network` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:21.936918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:21.939770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:21.962337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:21.964558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:21.965404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:21.970981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 356/717] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:21.978487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:22.120394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38abb-a103-4a19-a23f-c0d1bc4f5feb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:22.157100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:22.157666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:22.157950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:22.158222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:22.159427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:22.159733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:22.161094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316246-369a-4fbf-99ee-4498d5fd5351 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:22.166142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 362/718] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:22.172330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:22.360726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5106-bcec-4109-ba77-e04a76ff3acb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:22.402389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:22.419426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:22.419993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:22.420274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:22.420547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:22.421238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] RBAC: Adding query filter params (type=network) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:22.421544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:22.422943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df91fb-fc76-42cd-9881-0d5149602f58 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:22.435627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 357/719] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:23.349953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8619-9ba5-4b75-86df-d2f90e8c2736 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:23.350503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8619-9ba5-4b75-86df-d2f90e8c2736 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:23.350503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8619-9ba5-4b75-86df-d2f90e8c2736 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:23.352189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 363/720] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:23.358186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7be5-fd58-441c-88f9-14bc958a379b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:23.358775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7be5-fd58-441c-88f9-14bc958a379b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:23.358775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7be5-fd58-441c-88f9-14bc958a379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:23.377291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0ead7be5-fd58-441c-88f9-14bc958a379b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:23.378608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0ead7be5-fd58-441c-88f9-14bc958a379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:23.509688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 358/721] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:23.545640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8619-9ba5-4b75-86df-d2f90e8c2736 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:23.582616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3ed1-26ea-4767-a56c-fb2d84a2fb19 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:23.582969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3ed1-26ea-4767-a56c-fb2d84a2fb19 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:23.583176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3ed1-26ea-4767-a56c-fb2d84a2fb19 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:23.584861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 359/722] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:23.590919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:23.591208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:23.591486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:23.609411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:23.610559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:23.655294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:23.679132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 360/723] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:23.710421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:23.783137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8619-9ba5-4b75-86df-d2f90e8c2736 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:23.797970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:23.833999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:23.834642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:23.834925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:23.835198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:23.846434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:23.851503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:23.852503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:23.853324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 364/724] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:23.858565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:23.879828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543f81-ab06-4dbc-aa42-54f656c87e33 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:23.947974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:23.948607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:23.948888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:23.949990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:23.950705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:23.952083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:23.988550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 361/725] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:23 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:24.033748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a0e9c-ed1b-4a62-9e75-19e16c4e5208 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:24.042053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:24.079576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:24.080197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.080477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.080832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.081549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:24.081877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:24.083360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:24.092640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 365/726] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:24.100852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:24.275948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48c787-9e22-488d-b935-82aae5ae3b64 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:24.289762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:24.316168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:24.316830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.317121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.317463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.332209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:24.333754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1ec669f5-0066-4b21-b82c-4a4d2bf1425e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:24.349435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:24.350595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:24.351472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:24.351472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:24.351472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:24.351472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:24.351472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 362/727] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:24.356126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:24.454230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fcb2b-e34f-47f9-872a-e9c866409ff4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.454230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fcb2b-e34f-47f9-872a-e9c866409ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.454230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fcb2b-e34f-47f9-872a-e9c866409ff4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.455259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 363/728] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:24.461356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730d82d-cf96-4d1d-8a56-7f5c2414f5e6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.461927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730d82d-cf96-4d1d-8a56-7f5c2414f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.462431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730d82d-cf96-4d1d-8a56-7f5c2414f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.476607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f2908-52f7-485b-ad83-3852e78ae524 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:24.501621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:24.501957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.502196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.502472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.503205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:24.503590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:24.505117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:24.518279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 366/729] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:24.519519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c730d82d-cf96-4d1d-8a56-7f5c2414f5e6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:24.520738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c730d82d-cf96-4d1d-8a56-7f5c2414f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:24.526806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:24.597955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:24.598431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 364/730] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:24.611651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a37d6-4365-4d0b-8b0b-12a9783f0ce0 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.611966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a37d6-4365-4d0b-8b0b-12a9783f0ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.612287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a37d6-4365-4d0b-8b0b-12a9783f0ce0 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.614171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 365/731] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:24.619283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.619719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.620008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.642626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:24.644697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:24.704656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798e60c-0c7f-4eec-9b7d-1c67eaad0a14 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:24.737691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 366/732] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 29 04:30:24.738665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:24.750344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:24.751046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.751328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.751606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.765620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:24.765620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:24.785700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:24.786631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:24.787523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:24.788038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:24.789905 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 367/733] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:24.793622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:24.868923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94f81b-151d-4329-9b96-87be5f4b7c4c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:24.893979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:24.905732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:24.906393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.906675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.906954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.910168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b088c65-ddb3-4a72-968b-48883b2dcccd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:24.918842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:24.923949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:24.925378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:24.926227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:24.930954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 367/734] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:24.931871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:24.951908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:24.952829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:24.953388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:24.953932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:24.966002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:24.971947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:24.972835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:24.973719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 368/735] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:24.974525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.032193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.050083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674d020-e2f8-4a99-bfb6-11b544bc26b6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.089865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3187f1-e689-4543-a573-fbb88c3967a5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.090444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.091078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.091372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.091653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.092451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:25.092760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.094220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12109de-7d67-4250-ab94-d15b55f1d2bc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.118095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 368/736] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:25.118095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87224-6c29-4496-9cfb-aff0a8b7f902 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.118095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87224-6c29-4496-9cfb-aff0a8b7f902 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.118095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87224-6c29-4496-9cfb-aff0a8b7f902 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.118095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 369/737] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:25.118095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b87224-6c29-4496-9cfb-aff0a8b7f902 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.133016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.133670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.133961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.134237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.134948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:25.135255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.136625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.146383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 369/738] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:25.151578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.154978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.227501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b87224-6c29-4496-9cfb-aff0a8b7f902 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.263194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f4e8-fefc-41e0-8d6a-764e875be631 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.264623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.265241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.265521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.265870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.266608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:25.266957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.269004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872641a8-334c-4d2d-a44c-ca014a4357ab None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.277358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 370/739] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:25.278654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a10434-9453-482e-971f-e8c168bed258 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.279006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a10434-9453-482e-971f-e8c168bed258 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.279208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a10434-9453-482e-971f-e8c168bed258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.286464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.298886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-24a10434-9453-482e-971f-e8c168bed258 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:25.300044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24a10434-9453-482e-971f-e8c168bed258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:25.305915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.306565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.306911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.307255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.372777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 371/740] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 29 04:30:25.373721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a10434-9453-482e-971f-e8c168bed258 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.391941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.394729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.397818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.493932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a10434-9453-482e-971f-e8c168bed258 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.505108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 370/741] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 29 04:30:25.505967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.538926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.539636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.539852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.540127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.542510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.553343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.554838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:25.571031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:25.571901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:25.572788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:25.572788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:25.572788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:25.572788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:25.572788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 372/742] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:25.573065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.617584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1045-5f3c-40ff-b459-0acb033211ee None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.622795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.655414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.656053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.656334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.656607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.667008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.668440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:25.684306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:25.685165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:25.686085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:25.686085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:25.686085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:25.686085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:25.686085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 371/743] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:25.686363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.693058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dd499-1935-4427-b024-77cde2e01479 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.732582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.733211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.733485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.733795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.734485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.735840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.753722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 373/744] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:25 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:25.753722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.805214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab0e0f-a9ef-4f85-a501-43ea3965ea58 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.819294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.857444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.858449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.858920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.859338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.872696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.874655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:25.892469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:25.893698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:25.894616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:25.894616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:25.894616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:25.894616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:25.901103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 372/745] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:25.902542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:25.905013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dac37e-16ea-4b94-ade7-008a7a6bae32 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:25.908038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:25.969262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:25.970064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:25.970351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:25.970632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:25.971886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:25.972200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:25.973570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:25.986285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 374/746] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:25.991552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.046280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d96b-1915-417f-8b79-69c87b57b9ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.097424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.098089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.098382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.098663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.099663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:26.100055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.101754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.117833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 373/747] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:26.119506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.130714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c816b5e-803c-47a1-9a37-fb2cb5d3fce4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.141829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:26.181589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.182674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.183618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.184101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.184999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:26.185858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.188132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.203453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 375/748] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:26.204584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.213318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:26.254601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7454b7-79a3-4191-8c54-e99449115a09 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.293552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.294237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.294522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.294796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.303299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.304770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:26.316787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:26.317756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:26.318677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:26.322594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc973eba-6f75-4bca-a82a-084f3b577978 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.324105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 374/749] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:26.324937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.359722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.360625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.361331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.361641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.372593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.374010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:26.391943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:26.392905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:26.393877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:26.398242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 376/750] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:26.399771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.435041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:26.456060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b362d0d-2093-4a09-9a72-6f329389dc91 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.496815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:26.516269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.517334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.517856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.517960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e540c-9c83-4c64-b7b6-477b176ea92c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.518396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.532731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.536076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.553473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.554122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.554410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.554696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.555484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:26.555799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:26.557016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:26.557881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:26.558759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:26.559201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b9dc-e811-4bee-9473-542cd0f9507a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.559270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 375/751] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:26.560090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.583767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 377/752] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:26.583767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1bd1-23d9-43eb-8b0a-e0e9c514e9fa None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.583767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1bd1-23d9-43eb-8b0a-e0e9c514e9fa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.583767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1bd1-23d9-43eb-8b0a-e0e9c514e9fa None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.583767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 378/753] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:26.583767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1bd1-23d9-43eb-8b0a-e0e9c514e9fa None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.677994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:26.681310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e58107-f5b2-44be-bff9-e3b1ba4f8114 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.696229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1bd1-23d9-43eb-8b0a-e0e9c514e9fa None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.719639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.720264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.720553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.720832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.721768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:26.722110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.723516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.732600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.733211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.733493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.733796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.734529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:26.734837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:26.736241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7178f5-0c97-4526-98a5-3c94f3b25de8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:26.742431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 376/754] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:26.743418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.757463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 379/755] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:26.758781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.759070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.759347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.777163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:26.778376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:26.789953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:26.865123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15fa0-03c7-4617-afb2-b581efdb97ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:26.873742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 380/756] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:26.874763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:26.942907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:26.944331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:26.945081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:26.945580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:26.982915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:27.034482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8043f-0371-414c-a295-d870e3956f5e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.058475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.060273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.097779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.098913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.099263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.099651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.111355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.112935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.122789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:27.132713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:27.133828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:27.134709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:27.134709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:27.134709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:27.134709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:27.134709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 381/757] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:27.135538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.210442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 377/758] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:30:27.212834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.268821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781b2e-184d-467b-87c8-37c88a40a29c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.299328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:27.309672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.310450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.310799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.311261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.312122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=a8075821457e4e8b8a50815e70f1d759) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:27.312774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.314332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.321162 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 382/759] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/role_assignments?user.id=a8075821457e4e8b8a50815e70f1d759&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:27.322844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.348930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c2852-9b9b-4e70-a93c-249687918d42 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.401640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.404172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.404699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.405246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.406132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.408504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:27.422081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:27.423099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:27.423915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:27.431328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 378/760] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:27.432357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.444825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:27.493993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033ef3-f452-406f-9f62-0889f9b017aa None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.540929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.543854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.544515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.544975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.547544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:27.547859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.549245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.572429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b724e-e44e-4f30-9768-c24061efcfe8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.577362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 383/761] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:27.578427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.649208 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.649885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.650162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.650436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.675120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.676578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.683390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:27.707364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:27.708308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:27.709190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:27.709190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:27.709190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:27.709190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:27.713506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 379/762] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:27.714838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.792625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ae6e-3071-4f02-869c-35c921feb642 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.810240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:27.871815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.872599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.872981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.874726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.875528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:27.875940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.879078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:27.892433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73bf03-a38c-4512-8acf-ad92c4edc3cb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:27.900310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 384/763] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:27.901427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:27.978060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:27.978706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:27.978992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:27.979256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:27.991797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:27.993290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:28.013064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:28.014255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 380/764] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:28.015141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.053270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bed60-743b-4749-9613-f725d8a6d31d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.071987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:28.103017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.103914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.104301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.104794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.105627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:28.106083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.107599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659eb62-28fb-4077-b07d-d50dab78dfca None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.128086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 385/765] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:28.129930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ba95-c579-4cef-8569-b59be58ed61f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.130272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ba95-c579-4cef-8569-b59be58ed61f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.130785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ba95-c579-4cef-8569-b59be58ed61f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.132127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 386/766] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:28.134493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ba95-c579-4cef-8569-b59be58ed61f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.161518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8435f9e-3504-490e-b6ea-77112b634b94 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.185397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:28.210477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.211435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.211817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.212199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.213254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:28.213821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.215296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.226095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 381/767] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:28.227086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.271644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ba95-c579-4cef-8569-b59be58ed61f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.313821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.315487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.315487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.317643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.317643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:28.317643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.318939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9045a9-81a3-4e2e-b12a-84e758f688ed None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.337446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 387/768] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:28.337446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.337446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.337446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.358493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:28.360294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:28.367175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b526bd5-9b1e-4570-9fce-08670dbea543 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.392606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:28.407588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.408231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.408509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.408812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.418091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.420261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:28.435767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:28.436686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:28.438499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 382/769] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:28.438975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.451232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 388/770] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:28.451792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.516276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:28.589038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2edef0-7a53-43dc-b697-1b43ca2c7d45 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.590688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e78b9-f80d-411a-84e7-8b2001bf9f8a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.635911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.636299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.636793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.637174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.637513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.637854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.638144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.638566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/2919227b992743178d0128981ad54c6b/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.639048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] RBAC: Adding query filter params (interface=public, service_id=5517153244914db8b066e3ce764b4bb7, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:28.639592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.641018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=2919227b992743178d0128981ad54c6b, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.641137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.643725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.651864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 383/771] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/endpoints?service_id=5517153244914db8b066e3ce764b4bb7&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:28.652521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.673627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 389/772] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:28 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/2919227b992743178d0128981ad54c6b/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:28.673627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.724703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:28.843006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512e79a-032c-49c3-9142-3bc62fd90e08 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.853650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ced9f3-a279-419f-8e66-e2342dd90ac7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:28.857502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:28.900647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.901313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.901612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.901784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:28.901934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.902607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:28.902713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:28.902921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.903017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:28.903334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:28.904076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:28.904346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.905439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:28.914693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:28.915685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:28.916763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 390/773] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:28.917525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:28.924372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 384/774] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:28.929376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:29.068748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:29.078966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc966a5-7ec2-4f9b-adaa-622cd0751dc9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.086956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d895880-8a67-4239-ac1e-2cdc3bbe400a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.136710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:29.137273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.137558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.137858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.138515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:29.139897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:29.151112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 391/775] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:29.152262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:29.166056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:29.166952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.167235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.167514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.168197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:29.168501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:29.170529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:29.184557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 385/776] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:29.191893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:29.273871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:29.302509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc9ad-de28-4057-b4c6-9a999096aacc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.359848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:29.360181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.362173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.362173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.362173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=3cb7a5feda014624a86d87043526023d) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:29.362173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:29.363286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:29.370390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 392/777] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:29 2022] GET /identity/v3/role_assignments?user.id=3cb7a5feda014624a86d87043526023d&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:29.423725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4dac-7cda-469c-9f73-de848aa681a7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.473059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:29.474160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.474747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.475219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.476130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:29.476647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:29.478425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb293853-ac91-4ed2-954c-e68255dd05cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:29.487989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 386/778] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:29.493430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:29.516164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb8bd-ef90-4949-a126-03ea03d859ba None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.516489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb8bd-ef90-4949-a126-03ea03d859ba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.517736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb8bd-ef90-4949-a126-03ea03d859ba None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.519900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 387/779] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:29.526518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.526804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.527076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.537131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:29.563692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:29.564947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:29.661752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 388/780] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:29.668737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788043d-08db-4bc4-8b96-498eba923ed3 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.719297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:29.741916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:29.742551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.742836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.743118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.746312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] RBAC: Adding query filter params (interface=public, service_id=0e9a28caa1db407daf01d75838c5ff28, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:29.746638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:29.750420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:29.765143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:29.772184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 393/781] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:30:29 2022] GET /identity/v3/endpoints?service_id=0e9a28caa1db407daf01d75838c5ff28&interface=public®ion_id=RegionOne => generated 194 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:29.776467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:29.913838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:29.944551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9284967-9447-4811-98d0-a80f8d87f18a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.983094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:29.983274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:29.983496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:29.984254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:29.984438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:29.985810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:29.991547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1fa87-601f-4667-89b9-4fb1787ce142 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:29.992467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 394/782] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:29 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:30.106383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:30.107069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:30.107354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:30.107638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:30.130160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:30.135197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:30.136262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:30.137238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:30.137920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 389/783] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:30.144647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:30.314061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8755a-e754-4a81-9d59-a9e3aa4486ad None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:30.350950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:30.351563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:30.351863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:30.352122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:30.352836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:30.353142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:30.354538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:30.369063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 395/784] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:30.374695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:30.467196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:30.485768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0de9c-297a-43e8-919d-d19bdc8c4c7b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:30.524288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:30.525261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:30.525804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:30.526271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:30.537797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:30.539639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:30.555894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:30.556818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:30.557775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:30.557775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:30.557775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:30.557775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:30.562456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 390/785] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:30.566334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:30.582027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:30.677565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaa5dd-d163-4b91-8949-9799c484684c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:30.715828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:30.716756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:30.717189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:30.717732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:30.718639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:30.719090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:30.720704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:30.737717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 396/786] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:30.740631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:30.857264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991ba3-b26f-4d6d-be28-d1eae9724078 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:30.895390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:30.896421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:30.896903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:30.897345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:30.900897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:30.909069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:30.910803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:30.925076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:30.926301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:30.927480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:30.938547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 391/787] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:30:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:30.945305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:31.090166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:31.161469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25d39b-0336-4da6-b235-b84aa8b07895 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:31.227524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:31.228155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.228443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.228714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.229513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:31.229847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:31.231283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb3010-2d8d-4094-904c-c7812269cdc6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:31.259460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 397/788] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 29 04:30:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:31.266410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:31.279749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708407-6e85-42a3-a716-5b6a24e0f785 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.280174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708407-6e85-42a3-a716-5b6a24e0f785 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.280551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6708407-6e85-42a3-a716-5b6a24e0f785 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.285014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 398/789] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:31.291146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.291803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.292171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.342981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:31.344807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:31.411164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069f3d-dcf2-4ef9-b049-609d9623baa9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:31.451875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:31.453060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.453477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.456115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.469172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:31.471636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:31.488974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:31.490194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:31.491091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:31.491091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:31.491091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:31.491091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:31.498279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 392/790] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:31.502804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:31.560068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:31.575284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 399/791] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:31.620312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea9d6-20b8-4dc9-9817-bcbbe2292c05 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:31.630669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:31.663590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:31.664598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.666015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.666552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.667285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:31.667618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:31.668989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:31.703313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 393/792] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:31.718085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:31.730263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:31.794644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c017-a64a-478d-9a74-ec522e1f568f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:31.904001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d9855-88bd-4b0f-ba18-ebee126b916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:31.904678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9855-88bd-4b0f-ba18-ebee126b916a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.904973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9855-88bd-4b0f-ba18-ebee126b916a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.905257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9855-88bd-4b0f-ba18-ebee126b916a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.915008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7e4bb-f830-4023-bf84-542704a2572c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:31.932009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:31.932127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d9855-88bd-4b0f-ba18-ebee126b916a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2c8d9855-88bd-4b0f-ba18-ebee126b916a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:31.940407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:31.941774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 400/793] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:31.942601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d948a-9ca5-4880-ba15-973fd7ea0280 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.943354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d948a-9ca5-4880-ba15-973fd7ea0280 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.943354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d948a-9ca5-4880-ba15-973fd7ea0280 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:31.948173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 401/794] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:31.948992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d948a-9ca5-4880-ba15-973fd7ea0280 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:31.990772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:31.990772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:31.990772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:31.991090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.004216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.005867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3613036f-4399-4dcd-aa1d-c83fa890cd1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:32.022126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:32.023057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:32.023932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:32.028119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 394/795] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:32.029690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.029992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.030388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.052148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:32.053508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:32.113994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d948a-9ca5-4880-ba15-973fd7ea0280 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.130966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:32.148636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 395/796] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:32.148636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.166220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.167535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.168064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.168539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.169550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:32.170101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.171909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14346bcc-62a4-468d-a835-d4222061a0eb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.182576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 402/797] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:32.183424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0833-4f39-4d7f-b6d4-978f22bb249d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.183947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0833-4f39-4d7f-b6d4-978f22bb249d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.184088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0833-4f39-4d7f-b6d4-978f22bb249d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.189526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 403/798] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:32.190449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0833-4f39-4d7f-b6d4-978f22bb249d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.268806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:32.274334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183af07-5a0a-4503-97cd-d19d5ffd0d08 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.321361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0833-4f39-4d7f-b6d4-978f22bb249d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.321974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.322580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.322944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.323131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.323885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:32.324862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.326474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.352399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 396/799] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:32.352399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.379707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.380366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.380651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.380927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.381831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.383520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-233a0f79-9028-4948-a859-5697893a8158 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:32.396097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:32.397070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:32.398398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 404/800] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:32.399240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.399572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.399664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.420415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:32.422038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:32.470049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:32.489640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3829-ad98-423d-9d73-3b01b199808f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.516108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 405/801] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:32.517024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.535561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.536575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.537116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.537626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.556724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.559284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:32.579086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:32.580192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:32.581785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:32.581785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:32.581785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:32.581785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:32.581785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 397/802] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:32.582893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.604210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:32.659099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0622f09-4f77-476a-8c2f-edaef9120e30 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.699086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.700438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.701392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.701957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/a8075821457e4e8b8a50815e70f1d759/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.707986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6733-83f2-4bc5-9f18-a81d1287ca5a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.723555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=a8075821457e4e8b8a50815e70f1d759, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.725303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.751474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.752039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 406/803] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:32 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/a8075821457e4e8b8a50815e70f1d759/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:32.753035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.753431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.753840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.754583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.754717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:32.755124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.757392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.763320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 398/804] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:32.763903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:32.809694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:32.860259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:32.900623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4aed8-933a-4477-a35a-e1a0993c2981 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.948870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:32.949658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:32.951287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:32.951287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:32.951287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:32.951512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:32.952442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61a18b-8f80-460c-8112-ffe108488578 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:32.952899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:32.970115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 399/805] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:32.970886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.003093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed7fa7-b166-42e8-af2a-44d2af39dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.003841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7fa7-b166-42e8-af2a-44d2af39dc0e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.004483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7fa7-b166-42e8-af2a-44d2af39dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.008114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7fa7-b166-42e8-af2a-44d2af39dc0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.020258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed7fa7-b166-42e8-af2a-44d2af39dc0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c9ed7fa7-b166-42e8-af2a-44d2af39dc0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:33.025965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:33.026935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:33.027756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 407/806] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:33.028608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72eda-96a8-4ee6-b2f8-bf4acd4235c0 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.029273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72eda-96a8-4ee6-b2f8-bf4acd4235c0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.029691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72eda-96a8-4ee6-b2f8-bf4acd4235c0 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.031171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 408/807] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:33.035915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b72eda-96a8-4ee6-b2f8-bf4acd4235c0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.102103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd2e36-0d34-44bb-9f76-9a706d33c360 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.146308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:33.161419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.162086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.162383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.162624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.163513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:33.163820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.165203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.167217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:33.175610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 400/808] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 29 04:30:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:33.176739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.178607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b72eda-96a8-4ee6-b2f8-bf4acd4235c0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.219176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.219976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.220261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.220737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.229573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.231072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-65266854-200b-4685-86b1-14693dc606a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:33.248659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:33.249821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:30:33.250750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:33.258316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 409/809] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:33.260970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.261226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.261573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.283117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:33.284926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:33.321365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ea4a4-ad7b-4306-9d3c-7355a95b5d9e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.360989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.361653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.362500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.362778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.363498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:33.364036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.366214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.367753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 410/810] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:33.368814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.379156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 401/811] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:33.380541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.454662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:33.464803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:33.497544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281b47-c1f8-4b5f-bb59-7cba13963724 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.520624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5a07b-d766-4002-9d67-e07f09b27979 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.545957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.546584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.546863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.547135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.547841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.549782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.568527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.569300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.569555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.569961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.570816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:33.571205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.572969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.586593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 411/812] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:33.587244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.604924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 402/813] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:33.606327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.788347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f6c7a-8b8e-428c-ad61-e9bc98a37fda None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.817747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffd05f-d0a1-4013-a821-6a66613fff5f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:33.818754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:33.843685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:33.846624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.847626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.847923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.848207 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.875401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.876887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.880556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:33.881218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:33.881845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:33.882225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:33.884384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:33.884384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:33.901448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:33.902536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:33.904004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 403/814] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:33.904800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:33.911158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:33.912569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:33.914838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:33.914838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:33.914838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:33.914838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:33.914838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 412/815] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:33.914838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.058297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4bd72-2f60-42a9-9b41-5e57a93c626a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.102788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.103422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.103711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.104819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.108244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333553d4-abb8-43b9-826d-c962e329b670 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.162031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.162668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.162953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.163286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.163977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:34.164284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.165553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:34.167066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.178136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 413/816] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:34.183497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.189438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.191592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.251750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:34.318081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b731d-3ba3-4d3d-9240-500fb8c5e2c7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.369749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202563d-d494-4661-a755-14f86966c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.370780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202563d-d494-4661-a755-14f86966c717 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.371451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202563d-d494-4661-a755-14f86966c717 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.372396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202563d-d494-4661-a755-14f86966c717 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.373760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202563d-d494-4661-a755-14f86966c717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:34.374284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202563d-d494-4661-a755-14f86966c717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.376384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202563d-d494-4661-a755-14f86966c717 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.396441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 414/817] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:34.396441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202563d-d494-4661-a755-14f86966c717 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.415954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 404/818] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:30:34.417428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.517428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:34.523776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202563d-d494-4661-a755-14f86966c717 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.538485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:34.568308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe828fb-7542-4925-b22d-4859114c567b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.571746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.572658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.574415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.574929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.575827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] RBAC: Adding query filter params (type=network) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:34.576368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.578978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.588753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 415/819] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:34.589988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.619665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.620314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.620598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.620876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.632885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.634951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:34.657222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:34.658228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:34.659843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:34.664638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 405/820] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:34.665384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.720643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574930b-37dc-4192-8649-fba494e67d69 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.758029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.759062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.759564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.760053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.773203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.775161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:34.797134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:34.798491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:34.799414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:34.799414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:34.799414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:34.799414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:34.803444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 416/821] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:34.804533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.809954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe948e3f-cec6-4687-95ac-1d7373f07011 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:34.823261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:34.849885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:34.850529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:34.850809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:34.851078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:34.851817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:34.853236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:34.885756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:34.907956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 406/822] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:34.909428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:34.968369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b46e6-21cf-42e1-8e49-60ac0fbf01ba None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.038107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.039428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.039981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.040459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.041813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:35.042550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.045758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdef2fd-06cf-4baa-9ca1-7801d0d43498 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.071963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 417/823] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 29 04:30:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:35.074435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881d2e-7bf9-4be3-a606-4dba6e91c5cd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.074933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881d2e-7bf9-4be3-a606-4dba6e91c5cd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.075411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881d2e-7bf9-4be3-a606-4dba6e91c5cd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.077675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 418/824] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:35.078698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881d2e-7bf9-4be3-a606-4dba6e91c5cd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.108562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2e79-5422-4429-95b8-4deaf1270f39 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.173285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.173975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.174796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.175080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.176025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:35.176282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.179017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf860d6-391a-48aa-8783-fac9455b065e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.193107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:35.199026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 407/825] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:35.199026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.199026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.199026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.219811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:35.221722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:35.240477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881d2e-7bf9-4be3-a606-4dba6e91c5cd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.286659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.287311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.287601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.287880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.299504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.300980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.308909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:35.318029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:35.318929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:35.319787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:35.319787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:35.319787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:35.319787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:35.319787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 419/826] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:35.320074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.331033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 408/827] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:35.331882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.466381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8664c53-1577-4383-8550-8a5416fcc186 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.476379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c0f00-5b07-4998-91ab-7d46e51657ac None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.500729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:35.508174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.509089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.509466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.510183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.511249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:35.511651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.513659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.519431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.520088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.520377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.520662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.531412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 409/828] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:35.531412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.531670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.531670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:35.543940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:35.544961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 420/829] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:35.550811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.595334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:35.665384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee2b8c-50dc-4a69-9d17-ef7b62a6519d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.679497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c5465-9c45-4272-9775-471fb915f087 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.713627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.715027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.715620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.716109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.719538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.720189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.720475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.720753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.728675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.729626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:35.730198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:35.735931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:35.737043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:30:35.737909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:35.742852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 410/830] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:35.743051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:35.743902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:35.744783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:35.746979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.749235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 421/831] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:35.750251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.800585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:35.867061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58c55-3c6e-460d-8aae-d2e0602e990a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.870210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92662fe9-1c41-4fc8-8266-bff255fa68f0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:35.880834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:35.907288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.907924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.908210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.909050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.909810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:35.910125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.911495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.913089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:35.914194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.914547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.914901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.915723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:35.916107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:35.918356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09347a-7774-4cf9-bf64-868e717c3dea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:35.920218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 422/832] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:35.925508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:35.932204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 411/833] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:35.934224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb39f48-4686-44a5-a94f-fec251ec55ab None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:35.934512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb39f48-4686-44a5-a94f-fec251ec55ab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:35.934788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb39f48-4686-44a5-a94f-fec251ec55ab None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:35.937648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 412/834] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:35.937648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb39f48-4686-44a5-a94f-fec251ec55ab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.045017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b49ff-f078-4754-ba0a-c60bf80d70fc None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.046615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:36.055123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb39f48-4686-44a5-a94f-fec251ec55ab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.083251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.084392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.084832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.085106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.085897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:36.086205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.087624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.094772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.095684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.096202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.096664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.100037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 423/835] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:36.100849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.112539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.114045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f6da5838-2260-45aa-b55f-5f2a1e7a3d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:36.130318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:36.131409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:36.132488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:36.132488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:36.132488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:36.132488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:36.137781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 413/836] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:36.137781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.137781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.137781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.153634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:36.154922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:36.170465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:36.215607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefb4a8-39d6-4e6f-9879-4e6d94f9388c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.229484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 414/837] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:36.230267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.263080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.263722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.264008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.264287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.265083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=2919227b992743178d0128981ad54c6b) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:36.265397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.266990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.283784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 424/838] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/role_assignments?user.id=2919227b992743178d0128981ad54c6b&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:36.283784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.312348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:36.384941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10750ca0-4bbf-42a0-85cc-45ec34d5e4b4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.409214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27abd2b-d910-4f22-b2cb-1798dd0fe868 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.432706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.433987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.433987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.435639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/3cb7a5feda014624a86d87043526023d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.437319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=3cb7a5feda014624a86d87043526023d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.438794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.453442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.454358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.454535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.456347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.456464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:36.456841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.458375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.461578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 415/839] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:36 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/3cb7a5feda014624a86d87043526023d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:36.462629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.481761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 425/840] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:36.482360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:36.484970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.610707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522361b6-ae93-4f1e-93b4-1d3208f8bd7a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.661177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.662452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.662874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.663350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.664165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.666606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.674909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:36.679333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:36.680395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:36.681207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:36.683845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 416/841] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:36.691014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.702047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566c1a4-e0d8-4da8-afb8-04c3e845fd34 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.784047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.784699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.784989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.785265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.796090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:36.803463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.804817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:36.823843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:36.824809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:36.826196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 426/842] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:36.834122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:36.843782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73598fb-f267-4f21-82b1-078ca0658da2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:36.918150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:36.919140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:36.919647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:36.920125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:36.921028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:36.921539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:36.925758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:36.933445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 417/843] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:36.938470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:37.015251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aea0fe-df2e-4d7e-a7f8-8c3e0935d80d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:37.055086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:37.055832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:37.056130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:37.056674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:37.057540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:37.057904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:37.059348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:37.090276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 427/844] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:37.091291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:37.099265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:37.134856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7450f-85fb-4940-80ac-e01bd8b939d9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:37.190809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:37.191763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:37.192254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:37.193257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:37.194191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:37.194921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:37.196491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:37.217115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787d91f-f8cb-4649-be1d-2308ce73dbeb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:37.217858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 418/845] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:37.265581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:37.266311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:37.266586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:37.266866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:37.355346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:37.357629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:37.359929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:37.480486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 428/846] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:30:37.490903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:37.501621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:37.657691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ddb3-f2f6-4ad3-aee7-9d6cb3656778 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:37.696968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:37.701616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:37.701616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:37.701616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:37.709572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:37.712100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:37.726941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:37.727830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:37.728692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:37.728692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:37.728692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:37.728692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:37.728692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 419/847] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:37.739022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:37.878248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bf215-587a-44ec-a41e-e6636f2132c4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:37.880650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:37.918963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:37.919602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:37.919892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:37.920173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:37.920872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:37.921181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:37.922588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:37.957623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 429/848] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:37.961860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:38.035929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:38.087376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf6e57-032c-4912-9696-e44851c8e908 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:38.123708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:38.126120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.126120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.126120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.133619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:38.133619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:38.145566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:38.146872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:38.147749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 420/849] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:38.152619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:38.263449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d2ef0-d30a-4b5f-aa07-2bae7c36ad6f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:38.308819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:38.313614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.313614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.313614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.314796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:38.315125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:38.316603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ba7b-2ea4-4e23-87f4-a6da3f33917e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:38.331567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 430/850] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:38.338120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:38.454002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e067e-9d56-4d65-a07f-65a67738a684 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:38.470431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:38.492238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:38.492979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.493356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.493779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.494661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=a8075821457e4e8b8a50815e70f1d759) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:38.495237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:38.496767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d6202-2bf6-4b24-8d21-9721df6ba343 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:38.503573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 421/851] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:38 2022] GET /identity/v3/role_assignments?user.id=a8075821457e4e8b8a50815e70f1d759&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:38.538083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240544-7f3b-46b0-a94b-45b03c7792dd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.538386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240544-7f3b-46b0-a94b-45b03c7792dd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.538675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74240544-7f3b-46b0-a94b-45b03c7792dd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.540314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 431/852] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:38.550098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.550098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.550098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.567930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:38.569485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:38.755641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 422/853] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:38.774230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a2c2-2a29-420e-9d12-685b6cad4593 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.774521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a2c2-2a29-420e-9d12-685b6cad4593 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.774803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53a2c2-2a29-420e-9d12-685b6cad4593 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.776361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 432/854] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:38.782201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:38.782346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:38.782346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:38.782346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:38.804519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:38.806809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:38.830241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:38.898618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 433/855] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 29 04:30:38.930650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:38.956396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1a05c-288d-4492-a129-b11906ad16bc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:38.973430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:39.021066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.021752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.022037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.022315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.023160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:39.024329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:39.038639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:39.039620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:39.040455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:39.046571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 423/856] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Jul 29 04:30:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:39.047421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:39.052550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f7e8-2e59-4b42-911e-b992148bc8ad None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:39.101913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.102990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.103564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.104606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.127372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:39.135610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:39.136536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:30:39.137391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:39.148587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 434/857] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:39.155257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:39.183360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:39.193985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb77140-3366-4e0c-bd59-a9a967fc2714 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:39.243674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.245002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.245112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.245372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.256783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:39.256783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:39.256783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:39.259688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 424/858] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:39.260990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:39.315160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:39.361698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd837eb-5dbd-4007-b68d-017ccbc1fd80 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:39.405882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f34c4-5827-4b50-bbce-6623a86b19c4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:39.428987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.433629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.433629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.433629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.433629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:39.433629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:39.433629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:39.449620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.449620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.449620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.449620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.457209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 435/859] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:39.457369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:39.457369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:39.461613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358b133-3b82-4f81-8331-433acb367f13 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:39.463601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:39.477620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 425/860] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:39.550778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3447-1090-4030-98a9-aa562dca47c0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.551118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3447-1090-4030-98a9-aa562dca47c0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.551351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e3447-1090-4030-98a9-aa562dca47c0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.552816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 426/861] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:39.563670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.563990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.564238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.587061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:39.604463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18d98b-b479-4990-873b-375b672bd22d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:39.608920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:39.612379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:39.653635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.653635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.653635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.653635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.678106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:39.679710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:39.713588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:39.714531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:39.715490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:39.715490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:39.715490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:39.715490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:39.718233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 436/862] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:39.727261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:39.760944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 427/863] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:39.799569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:39.852170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:39.911355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c79bd-19b0-412a-b32d-8ebf59959523 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:39.984243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:39.990969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:39.992006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:39.993280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:39.994408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:39.995459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:39.996900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:39.998673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:40.012815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88e9f-c93f-4661-a4d0-d61f9e8bf853 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:40.026337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 437/864] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:40.034637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:40.126512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:40.127178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:40.127447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:40.127740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:40.128425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:40.143112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:40.156468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd29acc-f899-4755-b12c-bc4542289ebb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:40.193850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 428/865] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:39 2022] POST /identity/v3/services => generated 251 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:40.230570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:40.231625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:40.232166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:40.232650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:40.258578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:40.260516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:40.295625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:40.296634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 29 04:30:40.297556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:40.309690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 438/866] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:30:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:40.316145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:40.512961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:40.527423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8aa58-dd4c-4a2d-9893-911afe06538c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:40.571872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:40.572740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:40.573165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:40.573581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:40.574536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:40.575011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:40.576586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bfb0f-880a-4c91-af16-5af58d70ebfa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:40.595753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 429/867] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 29 04:30:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:40.602030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:40.652635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:40.710337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae81c-fe29-495a-ac7f-8c62083feb4f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:40.745018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:40.745898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:40.746322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:40.746729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:40.821821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:40.823233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:40.878309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fc3d-23cd-43f8-bce5-e25b9415ed46 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:40.878619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fc3d-23cd-43f8-bce5-e25b9415ed46 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:40.878873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fc3d-23cd-43f8-bce5-e25b9415ed46 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:40.880489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 430/868] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:40.881792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:40.885269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:40.885562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:40.885879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:40.904483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:40.906074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:40.933224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 439/869] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:40 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:30:40.940374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:40.989722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 431/870] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:41.013079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.056242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb281cd6-e12d-4510-8d1e-8d4bb52f07de None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.096923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.097712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.098151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.098500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.109443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.109897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:41.111620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.114419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:41.131035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:41.132028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:41.133945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:41.133945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:41.133945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:41.133945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:41.133945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 440/871] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:41.136515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7b6f-d092-4ac8-b3f4-a76793ca4506 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.139637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.181879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.183043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.183484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.183904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.198189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:41.205255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:41.206186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:30:41.207008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:41.214636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 432/872] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:41.216117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.272216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa96a3a-cff2-4691-802d-3c3d5ef51eef None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.313234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.314479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.315531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.316037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.316931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:41.317656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.319369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.333146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 441/873] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:41.338195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.340576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019434bc-8f78-46df-818a-599e91b6ee05 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.376027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.376568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.376850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.377787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.378496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:41.378797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.380158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.385659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:41.395975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 433/874] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:41.396984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.411876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:41.458843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370dd32-627b-4251-9462-4c43493dea98 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.499256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.500294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.500809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.501294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.512617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.514879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.530685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67dac-edf4-44f1-b370-4ee13d0ef074 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:41.531014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:41.531861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:41.532733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:41.535074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 442/875] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:41.541831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.596870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.598522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.599165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.600681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.619899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.626126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:41.653112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:41.654103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:41.655013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:41.655013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:41.655013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:41.655013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:41.660146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 434/876] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:41.666728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.762312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b308-56b5-42f2-812e-1a129bf0b2ff None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.773327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:41.790199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:41.811225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.811853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.812140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.812419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.813360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:41.813709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.815875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e947c-8506-4fe3-9d66-c3e4544bc43a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.834850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee33bd-0a1d-4092-a1a7-a56fa15923e8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.835589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 443/877] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:41.837024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcea2f-7a90-4e8b-ba09-8198f853f376 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.837319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcea2f-7a90-4e8b-ba09-8198f853f376 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.837798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcea2f-7a90-4e8b-ba09-8198f853f376 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.839180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 444/878] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:41.839897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcea2f-7a90-4e8b-ba09-8198f853f376 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:41.878633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:41.879346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.879730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.880114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.880918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:41.881380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:41.882950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ba872-d0c3-42be-a61d-43030e9c4c08 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:41.896663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 435/879] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:41.898088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:41.898482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:41.898877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:41.918165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:41.919369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:41.956818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcea2f-7a90-4e8b-ba09-8198f853f376 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:41.993068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 436/880] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:41.994191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.006437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.007179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.007593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.007935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.008860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=3cb7a5feda014624a86d87043526023d) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:42.009241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.010830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.021692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 445/881] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/role_assignments?user.id=3cb7a5feda014624a86d87043526023d&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:42.021692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.063693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.076521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.149198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81add-85ed-4b69-9adc-bc6ce505544c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.155832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053210-0d7d-44fb-8a1e-2387ad4c7b4f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.194693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.195333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.195621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.195900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.196617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.198036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.202084 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.202738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.203024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.203340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.212436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.214043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.221622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 446/882] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:42 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a5df3b09-e551-43ad-85fc-579a5e1629b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:42.234731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:42.235758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:42.237258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 437/883] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:30:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:42.243197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.360582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.372139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a9e3-b797-4f7e-9112-c4fc9cdc32ad None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.410710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.411681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.411971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.412259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.413157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:42.413478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.414956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.434309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 447/884] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:42.435417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a8150-9d10-40c9-b743-9331051d57c4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.435855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a8150-9d10-40c9-b743-9331051d57c4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.435966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a8150-9d10-40c9-b743-9331051d57c4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.437285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 438/885] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:42.442603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.442792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.443085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.443367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.463040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:42.464260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:42.549724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 439/886] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:42.551350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af368d12-0796-4b61-8c6d-a37477277750 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.566713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.590322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.591500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.591789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.592077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.604525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.630131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.674928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.676712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.682497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc51f9-0c39-419d-adad-c5774337ea38 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.718826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.719434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.719718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.719992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.721241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.722644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:42.732008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:42.733989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:42.735457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:42.738223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 440/887] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:42.739544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.796088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 448/888] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:30:42.801756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.841994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.848748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ec736-bea8-4687-bb33-bf19435d3673 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.860838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:42.888818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.889637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.890000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.890344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.891090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:42.891469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.893793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.903696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 441/889] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:42.905002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:42.909141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374b7a0-5783-4787-b02b-d124a23d4766 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:42.947066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:42.947721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:42.948006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:42.948285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:42.960018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:42.961478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:42.979230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:42.980165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:42.981582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:42.981582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:42.981582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:42.981582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:42.985205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 449/890] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:42.994670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:43.025124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e395afa-3e86-4a56-bca5-ec31371feca1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.063066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.063785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.064070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.064901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.065583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:43.066042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.067462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.073644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 442/891] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:43.078997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:43.112256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:43.120632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cbe9a-cf33-4813-987f-c39a0a9af7a9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.128408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:43.161370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.162012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.162291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.162564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.163242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:43.163544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.164903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.181933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 450/892] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:43.186892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:43.207698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66159c-1017-440f-ad81-dc2e3be3fd19 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.244096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.244811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.245102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.245377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.246172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] RBAC: Adding query filter params (interface=public, service_id=7fc2b23e2f8548afb0c5bd8b413e5166, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:43.246485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.248456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.261646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 443/893] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:30:43 2022] GET /identity/v3/endpoints?service_id=7fc2b23e2f8548afb0c5bd8b413e5166&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:43.263967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:43.315954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe943ab-ad9b-46c1-bfc8-38b78f418184 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.353839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.354816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.355272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.355720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.363556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.365212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:43.378214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:43.379076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:43.379928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:43.381453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:43.383684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 451/894] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:43.388917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:43.399549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078a4e9-fc81-421c-be86-afc58cb54902 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.426574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:43.446782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.447363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.448980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.448980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.448980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.450074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.456389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 444/895] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:43 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:30:43.518039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45252-2c01-4906-bb76-2eaa27a26031 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.556714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.557403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.557759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.558044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.558811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:43.559124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.560659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdf4ff-e5f0-4192-a10e-1a763422be0e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.574987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 452/896] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:43.582292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:43.696005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16413ab3-f629-4595-a19c-fb6cd00cf13b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:43.730647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:43.731182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:43.731466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:43.731802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:43.732642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] RBAC: Adding query filter params (role.id=f770356edf23411f95eac2700c40a031, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=a8075821457e4e8b8a50815e70f1d759) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:43.732956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:43.734406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced5cfb-0c14-4790-985e-66784c0aa282 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:43.740765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 445/897] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:43 2022] GET /identity/v3/role_assignments?user.id=a8075821457e4e8b8a50815e70f1d759&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=f770356edf23411f95eac2700c40a031 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:44.207593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b0c1-8c02-422a-85ac-628b908cd69a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.208561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b0c1-8c02-422a-85ac-628b908cd69a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.209002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b0c1-8c02-422a-85ac-628b908cd69a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.210763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 453/898] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:44.216177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693d30d-f9c8-4a0d-82ae-58c60368b2b4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.216718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693d30d-f9c8-4a0d-82ae-58c60368b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.217219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693d30d-f9c8-4a0d-82ae-58c60368b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.235562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d693d30d-f9c8-4a0d-82ae-58c60368b2b4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:44.237687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d693d30d-f9c8-4a0d-82ae-58c60368b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:44.249263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:44.308759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 446/899] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:44.330581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9b0c1-8c02-422a-85ac-628b908cd69a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:44.424606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:44.430922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850a8d-4660-435a-85c7-2a0379531cbd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.431208 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850a8d-4660-435a-85c7-2a0379531cbd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.431717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850a8d-4660-435a-85c7-2a0379531cbd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.433527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 447/900] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:44.438070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.438582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.439118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.443363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9b0c1-8c02-422a-85ac-628b908cd69a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:44.458571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:44.460550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:44.480614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:44.481263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.481552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.481864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.482492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:44.483922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:44.493850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:44.494891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:44.495782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 454/901] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:44.503182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:44.551397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 448/902] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:44.573301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:44.618945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942501b3-bbb4-4a2a-9250-59078c0ac212 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:44.662162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:44.665967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:44.667044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.667889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.668794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.669944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:44.670427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:44.672742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:44.685230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 455/903] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:44.686576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:44.701312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a9cd3-ab3b-4ec2-9f22-cdde9110d3e5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:44.707004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:44.749557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:44.750497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.750940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.751473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.752891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:44.754275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:44.764425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:44.765366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:44.766235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:44.770540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 449/904] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Jul 29 04:30:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:44.771404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:44.820495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f01e-d35b-440d-a6ec-10647eceeee2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:44.860866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:44.861551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.862055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.862341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.863027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:44.863339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:44.864809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:44.870666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 456/905] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:44.905439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbd9ad-a989-4c80-a9a1-18acc6fe430b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:44.952080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:44.952725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:44.953012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:44.953293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:44.954043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:44.954352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:44.956300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:44.965156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 450/906] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:44.971574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:45.057504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:45.084562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ea748-bb87-4966-9d59-5e3c1329f934 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:45.120824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:45.121452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.121772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.122052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.122739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:45.123048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:45.124470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:45.129944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 457/907] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:45.138659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:45.144285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:45.257659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec42a4f-5460-4947-9629-9e9e6d8307db None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:45.293241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:45.293897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.294186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.294463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.295218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] RBAC: Adding query filter params (interface=public, service_id=eb0cc1b2641d41b7ae5db65fdff4705f, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:45.295531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:45.296902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8b6e5-3917-4337-8c54-0442d01f34e0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:45.302704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 451/908] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:30:45 2022] GET /identity/v3/endpoints?service_id=eb0cc1b2641d41b7ae5db65fdff4705f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:45.310856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:45.418999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4f7e-ecde-43ac-814e-ebdeb0af6274 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:45.457929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97be9a-ca95-43f8-82ce-3499b4f07b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:45.458616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97be9a-ca95-43f8-82ce-3499b4f07b4f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.458906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97be9a-ca95-43f8-82ce-3499b4f07b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.459187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97be9a-ca95-43f8-82ce-3499b4f07b4f None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.459848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97be9a-ca95-43f8-82ce-3499b4f07b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:45.461225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97be9a-ca95-43f8-82ce-3499b4f07b4f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:45.467673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 458/909] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:45 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:30:45.613990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539f8c6-8b82-4a95-8ec7-9ec43847a271 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.614504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539f8c6-8b82-4a95-8ec7-9ec43847a271 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.614753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539f8c6-8b82-4a95-8ec7-9ec43847a271 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.616457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 452/910] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:45.621789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617969-2ba9-4458-b30d-f55c00acd7b7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.622373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617969-2ba9-4458-b30d-f55c00acd7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.622860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617969-2ba9-4458-b30d-f55c00acd7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.636348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:45.643344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-02617969-2ba9-4458-b30d-f55c00acd7b7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:45.644801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-02617969-2ba9-4458-b30d-f55c00acd7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:45.722758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 459/911] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:45.744796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539f8c6-8b82-4a95-8ec7-9ec43847a271 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:45.814012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:45.828260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fed2e-bd5b-4b49-ae41-49e57a3b8556 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.828628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fed2e-bd5b-4b49-ae41-49e57a3b8556 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.828829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fed2e-bd5b-4b49-ae41-49e57a3b8556 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.831170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 460/912] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:45.836302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.836585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.836869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.855666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539f8c6-8b82-4a95-8ec7-9ec43847a271 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:45.861214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:45.862535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:45.890577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:45.891154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:45.891439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:45.891720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:45.892946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:45.894622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:45.904304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:45.905304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:45.906158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 453/913] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:45.914584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:45.957642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 461/914] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:45.977278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.039100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f74e1-0a68-4342-a91b-b3460d8212b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.049076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:46.076253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:46.083620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.084249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.084664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.085078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.085802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:46.086111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.087976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.094990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2da8-f6ac-409f-9bd4-bfc1dd85315d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.095143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 454/915] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:46.099995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.131602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.132550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.132980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.133534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.146430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:46.152452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:46.153615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:30:46.154497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:46.156963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 462/916] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 29 04:30:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:46.164314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.220045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784107-e238-4e2b-8cb8-f1857fb866f4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.259270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.260281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.260797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.261436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.262442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:46.262949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.264604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.270516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 455/917] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 29 04:30:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:46.276624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.290377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9c04e-e616-4d16-a4c7-1cd6da00a982 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.325242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:46.338607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.339229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.339514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.339791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.340508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:46.340816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.342290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.351447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 463/918] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:30:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:46.358209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:46.358505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.417937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75baa70-092c-4d4e-8f8b-e33ec0b3f224 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.463400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557302-f229-41d7-9a15-4a087a489d47 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.466526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.467382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.467835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.468266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.469125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.471349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.505628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 456/919] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:30:46.515475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.516201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.516483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.516758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.530761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.532392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:46.549752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:46.550743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:46.551698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:46.551698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:46.551698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:46.551698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:46.551698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 464/920] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:46.557104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.673361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af7683-9162-49e9-b007-1c56218520a6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.690882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:46.710077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.710700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.710980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.711253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.711938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:46.712240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.713637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.727219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 457/921] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:46.732621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:46.771582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:46.841829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ac15-1e89-4788-94b2-f7c815cc577d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:46.877316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:46.877991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:46.878274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:46.878552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:46.886406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:46.888016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:46.900882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:46.901890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:46.902816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 465/922] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:30:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:46.909115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.013348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32007242-7c02-419f-9091-279fdfda6e38 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.049443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.050444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.050982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.051454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.052455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:47.052966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.054694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c86df8-ee47-4f2e-b644-1018133d6abe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.073093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 458/923] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 29 04:30:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:47.078862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.097305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4705-8e0d-4ed7-99b6-9d3224e05fec None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.097631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4705-8e0d-4ed7-99b6-9d3224e05fec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.097905 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4705-8e0d-4ed7-99b6-9d3224e05fec None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.100489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 459/924] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:47.104628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.104859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.105094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.124664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:47.126206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:47.156786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:47.201434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:47.203091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 460/925] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:47.211698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e0ba-3eca-43a9-9949-b9b20054bbe8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.226455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.252909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.253900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.254397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.254699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.268489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.269965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:47.289010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:47.290814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:47.292883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:47.292883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:47.292883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:47.292883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:47.292883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 466/926] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:47.300685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.351900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1ca84-09e2-4135-95f0-fbc0bce7e659 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.388916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.389938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.390435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.390917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.391802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.393561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.411922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 461/927] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:47 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:30:47.433663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e9e1-0942-48b7-8ded-87dd1667b21d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.481008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.481930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.482380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.482811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.483656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:47.484127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.485814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a72c0-5304-427e-b04c-c5c276f17f1a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.500833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 467/928] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:47.507192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.536630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:47.581395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1ec0-315c-42c5-885a-0ef336da6004 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.582077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1ec0-315c-42c5-885a-0ef336da6004 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.582457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff1ec0-315c-42c5-885a-0ef336da6004 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.583935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 468/929] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:47.589307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.589614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.589927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.598505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:47.611565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:47.612765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:47.620287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c74b44-03b8-44a1-b38e-01eccaa0ca6c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.664521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.665535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.666081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.666826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.675250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.677409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.693251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 469/930] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:47.694158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:47.695738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:47.697328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:47.699514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 462/931] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:47.705652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.719498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.819589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ca699-ba2e-443c-ab53-633c40b60b53 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.832794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:47.854635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5297b78-8c7b-40c6-b7b5-71724a9d09fe None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:47.856502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.857130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.857412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.857716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.858469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:47.858779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.860205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.862153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:47.877634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 470/932] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:47.881084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:47.903658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:47.904308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:47.904585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:47.904848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:47.905520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:47.906994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:47.917343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:47.918413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:47.919262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 463/933] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Jul 29 04:30:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:47.925483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:48.010449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376656d2-5269-4dc1-b2cf-982840bcb957 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:48.043416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986da0-6a13-4d27-97d1-b4d62b5a865f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:48.055453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:48.056184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:48.056486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:48.056762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/a8075821457e4e8b8a50815e70f1d759/roles/f770356edf23411f95eac2700c40a031` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:48.059118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=a8075821457e4e8b8a50815e70f1d759, role_id=f770356edf23411f95eac2700c40a031)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:48.060699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:48.088927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 471/934] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:30:47 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/a8075821457e4e8b8a50815e70f1d759/roles/f770356edf23411f95eac2700c40a031 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:30:48.091935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:48.092686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:48.093029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:48.093316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:48.094146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:48.094456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:48.096711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:48.103311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 464/935] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:48.108841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:48.180964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:48.234360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721540a-bc69-420b-bac0-424275151e6c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:48.272243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:48.273220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:48.273773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:48.274280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:48.275242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:48.275797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:48.277396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d55bc6-eec6-4f6c-ad87-ce5bad2d9e73 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:48.284025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 472/936] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:48.289837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:48.307243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:48.400528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98367a00-4d2e-41d4-975e-8ec68adabac6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:48.435463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cb725-eb2d-4542-83fd-d192fc90b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:48.436085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cb725-eb2d-4542-83fd-d192fc90b2a2 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:48.436371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cb725-eb2d-4542-83fd-d192fc90b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:48.436649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cb725-eb2d-4542-83fd-d192fc90b2a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:48.437369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cb725-eb2d-4542-83fd-d192fc90b2a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:48.438777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cb725-eb2d-4542-83fd-d192fc90b2a2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:48.461563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 465/937] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:48.801742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4710b0-a486-4992-a108-8f9b9e4125ad None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:48.802268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4710b0-a486-4992-a108-8f9b9e4125ad None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:48.802597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4710b0-a486-4992-a108-8f9b9e4125ad None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:48.804387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 473/938] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:48.809871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2394-70f7-4991-a215-3637387486ce None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:48.810319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2394-70f7-4991-a215-3637387486ce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:48.810692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2394-70f7-4991-a215-3637387486ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:48.829662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e58e2394-70f7-4991-a215-3637387486ce None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:48.830946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e58e2394-70f7-4991-a215-3637387486ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:48.895245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:48.911013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 466/939] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:48.934642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4710b0-a486-4992-a108-8f9b9e4125ad None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:49.049590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4710b0-a486-4992-a108-8f9b9e4125ad None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:49.067805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:49.086555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:49.087179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:49.087677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:49.087953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:49.088639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:49.090110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:49.092738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING keystone.server.flask.common [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 29 04:30:49.111221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.sql.core [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 04:30:49.111221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 29 04:30:49.111221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [parameters: {'id': 'c342d50342754ff3946f9a8efcf4cff9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 29 04:30:49.111221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c342d50342754ff3946f9a8efcf4cff9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c342d50342754ff3946f9a8efcf4cff9. Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 04:30:49.129110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 29 04:30:49.130033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application yield resource Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise self.value Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application session.commit() Jul 29 04:30:49.130964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.flush() Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application compat.raise_( Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 04:30:49.131836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 04:30:49.132724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 04:30:49.133508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [parameters: {'id': 'c342d50342754ff3946f9a8efcf4cff9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.134405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:49.135244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c342d50342754ff3946f9a8efcf4cff9. Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:49.136171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 474/940] 10.222.0.46 () {60 vars in 1140 bytes} [Fri Jul 29 04:30:48 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:49.143588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2394-70f7-4991-a215-3637387486ce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:49.249122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2394-70f7-4991-a215-3637387486ce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:49.286141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:49.286786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:49.287069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:49.287349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:49.294580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:49.296037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3ce8d834-59c2-478a-8c7e-a7ff13b151e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:49.307456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:49.308324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:49.309197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 467/941] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:49.315436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:49.421276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21e585-9459-42c2-ab72-59c00b411d01 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:49.456214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:49.456843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:49.457126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:49.457403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:49.458151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:49.458459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:49.460094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9474-bae4-43fd-b52e-93729c183d32 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:49.480254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 475/942] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:49.589308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79fdb-5e8d-4b32-a472-8a2b8f926550 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:49.589620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79fdb-5e8d-4b32-a472-8a2b8f926550 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:49.589893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79fdb-5e8d-4b32-a472-8a2b8f926550 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:49.591545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 468/943] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:49.597326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:49.597693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:49.597978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:49.619681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:49.621322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:49.651695 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:49.705713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 476/944] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:49.727918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d79fdb-5e8d-4b32-a472-8a2b8f926550 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:49.790782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:49.837792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d79fdb-5e8d-4b32-a472-8a2b8f926550 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:49.873612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:49.874320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:49.874602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:49.874877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:49.875502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:49.877034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:49.886617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:49.887617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:49.888445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 469/945] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:49.895836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.019122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652df00-8532-400c-8b0f-6892a7b1d161 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.057141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.057846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.058134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.058408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.059093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:50.059396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.060766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e85794-c1f7-4a57-84f7-5e759a8adfad None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.066594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 477/946] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:50.073290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.179587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bc896-b750-4c48-b21e-16fd4206487d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.197508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:50.208878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e8e46-8bc6-4ac7-a2eb-197344665fdf None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.209509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e8e46-8bc6-4ac7-a2eb-197344665fdf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.210056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e8e46-8bc6-4ac7-a2eb-197344665fdf None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.211790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 478/947] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:50.220090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.220698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.221084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.222234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.223026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.223457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.223880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.224719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:50.225172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.226726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.232628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 470/948] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:50.239157 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.241427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:50.242868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:50.269055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:50.325775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 479/949] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:50.342597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.344714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674843-3e76-4578-b6d4-2f1b5b094ad0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.380801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.381650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.382043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.382424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.383310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] RBAC: Adding query filter params (interface=public, service_id=e208b94e32cb4ad99bcf6616599d5e0e, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:50.383789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.385254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.391122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 471/950] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/endpoints?service_id=e208b94e32cb4ad99bcf6616599d5e0e&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:50.396550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.456337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821150-5c1d-4082-9114-c35ae4981699 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.460453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:50.497280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.497962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.498397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.498740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.512928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:30:50.516195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5bba4-414e-43ff-b85e-1c1222c9e748 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:30:50.519572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:50.520476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:50.521559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 480/951] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:50.528331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.556447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:50.558004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920028a5-e63e-4224-94b5-e6710cc63ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.559262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920028a5-e63e-4224-94b5-e6710cc63ebf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.559766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920028a5-e63e-4224-94b5-e6710cc63ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.560580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920028a5-e63e-4224-94b5-e6710cc63ebf None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.561660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920028a5-e63e-4224-94b5-e6710cc63ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.563259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920028a5-e63e-4224-94b5-e6710cc63ebf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.569724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 472/952] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:30:50.571295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186188c3-25f0-48db-9669-1a582748b7af None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.571642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186188c3-25f0-48db-9669-1a582748b7af None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.571867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186188c3-25f0-48db-9669-1a582748b7af None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.573313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 473/953] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:50.579495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.579894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.580365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.603662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:50.605261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:50.655671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dedeb0-c930-438d-8e69-3da1e69883b7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.698267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 474/954] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:50.706380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.707105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.707392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.707668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.708389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:50.708690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.710234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.720096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 481/955] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:50.724001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.726834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.786017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:50.833339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:50.851712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2083-ba38-4fac-a4ab-9d36f974c6d9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.857694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95a238-4fd5-4e94-a178-1b09d6fa4eb4 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:50.894679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.895334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.895707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.896066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.896791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.898288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.898788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:50.899649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:50.900030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:50.900404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:50.909677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:50.911119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:50.912403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 475/956] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:50.914860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:50.916712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:50.919731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:50.935624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:50.936488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:50.937353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:50.937353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:50.937353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:50.937353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:50.937353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 482/957] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:50.942564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.051887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80368-66a2-48e0-9f95-8bf825831e59 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:51.065559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d222-5475-4696-bb65-9ed2b5934245 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:51.068718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:51.084993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:51.091970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:51.092774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.093204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.093656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.094490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:51.095037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:51.097222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:51.108338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:51.109101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.109388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.109696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.110379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:51.110690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:51.115956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:51.116538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 483/958] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:51.117553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 476/959] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:51.118374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.123656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.241555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb8a4-1284-4f36-9181-2b511744f303 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:51.247960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21aa16-cf3c-49a8-b176-1324d840dec4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:51.286094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:51.286715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.287001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.287337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.288007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:51.288354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:51.289766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:51.290580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:51.292342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.292830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.293561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.295147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 477/960] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:51.302018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:51.303889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:51.318659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:51.319696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 29 04:30:51.320635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:51.323313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 484/961] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:30:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:51.331423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.368811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:51.448421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8435-fcab-4a2a-8f0b-f5efbcd27f66 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:51.483738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:51.484703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.485192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.485702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.487275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:51.487819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:51.489445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0dff-20e8-4f68-8a31-59a5c7797a3e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:51.507653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 478/962] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 29 04:30:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:51.513654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.569743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:51.619448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587f650-080b-4a85-a3df-2b0a5052e256 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:51.654526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:51.655210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.655502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.655780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.712004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028c09-87e0-4cc6-a393-639b2ed08535 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.712355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028c09-87e0-4cc6-a393-639b2ed08535 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.712561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028c09-87e0-4cc6-a393-639b2ed08535 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.714178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 479/963] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:51.724917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:51.725207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:51.725547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:51.732759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:51.734255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:51.744488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:51.746237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:51.831794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:51.849393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 480/964] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:51.861495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 485/965] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:30:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:30:51.867609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.873635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:51.898772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:51.992234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11021610-5718-4c12-aea8-f2c88a33b1f7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.016166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cb0ab-2f14-4a4c-9d89-e143849bfbad None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.032473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.033761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.034044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.034321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.035269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.037314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.057863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.sql.core [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 04:30:52.057863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 29 04:30:52.057863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [parameters: {'user_id': 'e92a88cc5a4142da8b7e2f8cbf062fd4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 29 04:30:52.057863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 29 04:30:52.059048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.059969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.060455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.060944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 29 04:30:52.066401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 04:30:52.067275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application yield resource Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application next(self.gen) Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.rollback() Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.force_reraise() Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise self.value Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application session.commit() Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 29 04:30:52.068242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._prepare_impl() Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.session.flush() Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._flush(objects) Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application compat.raise_( Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application flush_context.execute() Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rec.execute(self) Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 29 04:30:52.069165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 29 04:30:52.070086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result = self._query(query) Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application conn.query(q) Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application result.read() Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 29 04:30:52.070915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e92a88cc5a4142da8b7e2f8cbf062fd4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:52.071821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 29 04:30:52.072628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:52.073530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 486/966] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 29 04:30:51 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:52.080835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.080835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.081123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.097984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:30:52.102314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:52.103195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:52.104119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:30:52.104119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:30:52.104119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:30:52.104119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:52.108373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 481/967] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:52.109875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.191680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:52.218984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce16a27-bc26-491d-af60-4c728eaa9877 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.223721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e1f9d-dff1-4a72-b33a-3945efa9413b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.256998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.258023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.258515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.259021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.259318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.259945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.260229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.260693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.261464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:52.261811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.263190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.269176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.271164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.281783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 482/968] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:52.282695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:30:52.284817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:52.286004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 29 04:30:52.286959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:52.289582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 487/969] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:52.295576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.384257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:52.391155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a06e-c96b-4631-aab0-2dd12b1dcaaa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.419601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210c9e9-f4be-4c8f-b704-45933efcda3d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.429651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:52.434232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.435078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.435510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.435980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.444819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.446501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:30:52.459544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:52.460621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:30:52.461680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:52.462113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.462113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.462113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.462113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.462374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:52.462374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.463322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.468890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 483/970] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:52.470056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.508454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 488/971] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:52.587504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b19e9-6f8f-4211-84e8-1a29583a5e8a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.628871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.629803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.630235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.630657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.631584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:52.632041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.633662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49de81-3833-4932-9626-e5ff10243c55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.648229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 484/972] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:52.654733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.743400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26425cc5-7c41-4cc6-885d-fa9db94af3f5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.743680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26425cc5-7c41-4cc6-885d-fa9db94af3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.743960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26425cc5-7c41-4cc6-885d-fa9db94af3f5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.746563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 485/973] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:52.750760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.751047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.751328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.765438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c5be-1366-4be0-b17c-9fe1cecd5ed6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:52.771982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:52.773177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:52.806392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:52.811503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:52.812130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:52.812414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:52.812690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:52.813476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] RBAC: Adding query filter params (role.id=f770356edf23411f95eac2700c40a031, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=a8075821457e4e8b8a50815e70f1d759) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:52.813814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:52.815264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:52.825648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 489/974] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/role_assignments?user.id=a8075821457e4e8b8a50815e70f1d759&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=f770356edf23411f95eac2700c40a031 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:52.839598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:52.864055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 486/975] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:52.886234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:52.998659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7387e-383d-4f25-85b7-b3dab6756886 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:53.035394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:53.036052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.036333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.036608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.037242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:53.038673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:53.047966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:53.049647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:53.050525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 490/976] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:53.056017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:53.157014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de345b-7701-45bf-8b36-3871ab27d560 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:53.191946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:53.192581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.192864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.193140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.193846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:53.194152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:53.195516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c5e75-3d78-4fa0-9680-f76c60f32959 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:53.200493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 487/977] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:53.206491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:53.268264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:53.310996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd062e7-cf12-45df-b3d6-627c8c4e55e7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:53.324629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b243b-16e9-4fac-9587-e5771319c421 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.324925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b243b-16e9-4fac-9587-e5771319c421 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.325189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b243b-16e9-4fac-9587-e5771319c421 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.326679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 488/978] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:53.331750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.332033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.332308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.349175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:53.349824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.350111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.350390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.350530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:53.351069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:53.351416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:53.351747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:53.352784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:53.362751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 491/979] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:53.363730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:53.401720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:53.428793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 489/980] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:53.450482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:53.475317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d0cb0-b702-4470-9d5a-cbfa3304e2df None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:53.500223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:53.513318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2be9d-6c14-4ad2-bf15-ffd22ab8fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:53.513999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2be9d-6c14-4ad2-bf15-ffd22ab8fa2e None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.514284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2be9d-6c14-4ad2-bf15-ffd22ab8fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.514563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2be9d-6c14-4ad2-bf15-ffd22ab8fa2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.515273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2be9d-6c14-4ad2-bf15-ffd22ab8fa2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:53.516641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2be9d-6c14-4ad2-bf15-ffd22ab8fa2e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:53.538863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 492/981] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:53.566289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5453453-b566-42da-94a1-3342bcd704cf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:53.611469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8105a-95b8-41cc-b465-d307d4c18180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:53.612097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8105a-95b8-41cc-b465-d307d4c18180 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:53.612377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8105a-95b8-41cc-b465-d307d4c18180 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:53.612649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8105a-95b8-41cc-b465-d307d4c18180 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:53.613331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8105a-95b8-41cc-b465-d307d4c18180 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:53.614752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8105a-95b8-41cc-b465-d307d4c18180 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:53.632364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 490/982] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:53 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:30:54.942681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0cf76-15d6-4bfc-8fbf-88c3b5fbe9fd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:54.943125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0cf76-15d6-4bfc-8fbf-88c3b5fbe9fd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:54.943311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0cf76-15d6-4bfc-8fbf-88c3b5fbe9fd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:54.944837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 493/983] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:54.950124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:54.950529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:54.950694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:54.968566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:54.969793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:54.997131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:55.050128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 491/984] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:55.075619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0cf76-15d6-4bfc-8fbf-88c3b5fbe9fd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.179137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0cf76-15d6-4bfc-8fbf-88c3b5fbe9fd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:55.212158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:55.212727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.213013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.213292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] PATH_INFO: `/v3/services/image` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.213961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:55.215326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:55.224869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:55.226155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:30:55.227011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:55.229921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 494/985] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:55.231876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.331335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c8fe-d3e7-4fe0-b642-3e3da7b5ef6c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:55.366241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:55.366858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.367147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.367425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.368095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:55.368401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:55.369810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f692a1-c5e5-43b8-91d9-853522e92e0a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:55.379321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 492/986] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:55.380348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.427995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:55.488706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97d12a-cd31-4306-bd25-cf183afafdcb None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:55.522534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:55.523159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.523445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.523722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.524401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] RBAC: Adding query filter params (type=image) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:55.524711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:55.526118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901b8f-8e48-4c2d-a3ee-cc09cc7732cc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:55.537857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 495/987] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:55.556031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc73a9-a965-44f6-a941-8c32a94ebd1e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.556322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc73a9-a965-44f6-a941-8c32a94ebd1e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.556602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc73a9-a965-44f6-a941-8c32a94ebd1e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.558086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 493/988] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:55.563957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.564241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.564519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.584430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:55.586072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:55.661683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d562c-84df-45f7-b5a2-9295abebde6e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.662016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d562c-84df-45f7-b5a2-9295abebde6e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.662326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d562c-84df-45f7-b5a2-9295abebde6e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.663778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 496/989] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:55.669795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 494/990] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:55.669795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.670090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.670364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.686955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.689432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:55.691554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:55.711451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:55.732889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:55.766324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 495/991] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:55.789457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.795838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b0d8b-a6ab-40fd-9b96-9cbd5e0af7e5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:55.833747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:55.834523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.834782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.835015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.835761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:55.837228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:55.846622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:55.847660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:55.848495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 497/992] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:55.853776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.896094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd3d3-c89f-464f-92c9-66e74d89d8ce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:55.935330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:55.936078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:55.936365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:55.936666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:55.937296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:55.941386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:55.948632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:55.949630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:55.951440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 496/993] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:55.956694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:55.972929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e1e8c-e1f9-49d4-9569-44ba48cc6e8f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:55.974593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:55.976760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:56.010849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.011601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.011781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.012016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.012718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:56.012978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.014377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.024537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 498/994] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:56.025478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:56.074964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da528b81-5751-4370-b5ce-edbfc3638d84 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.111902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.112796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.113086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.113374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.114217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:56.114817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.116317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.122301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 497/995] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:56.128277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:56.129927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ade0af-2f58-4544-a61d-70b0f559f25b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.164967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.165589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.165896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.166182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.167100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:56.167413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.168786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.174699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 499/996] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:56.180060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:56.210552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:56.224091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:56.246797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3f25-c599-455c-8dc1-d67197765861 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.283399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.283928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.284210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.284525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.284862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a62b-1b2e-46ec-80d9-ced158fef140 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.285190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:56.285489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.287162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.292355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 498/997] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:56.298024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:56.325472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.326121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.326403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.326682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.327454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] RBAC: Adding query filter params (interface=admin, service_id=e208b94e32cb4ad99bcf6616599d5e0e, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:56.327763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.329128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.335485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 500/998] 10.222.0.46 () {56 vars in 1249 bytes} [Fri Jul 29 04:30:56 2022] GET /identity/v3/endpoints?service_id=e208b94e32cb4ad99bcf6616599d5e0e&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:56.340142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:56.403260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d340227-a244-4e3b-aff9-48777965aecb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.435672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:56.438624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.439850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.440063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.440340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.441083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] RBAC: Adding query filter params (interface=public, service_id=b77cf61725c044d796cfe5a30e466b4c, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:56.441414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.442786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.443944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497532d4-fdb3-4dbf-8df1-85fd30036d72 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.453867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 499/999] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:30:56 2022] GET /identity/v3/endpoints?service_id=b77cf61725c044d796cfe5a30e466b4c&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:56.454870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:56.465857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:56.483121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907efc0-024e-4519-bbb6-82d5a3a5681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.483734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907efc0-024e-4519-bbb6-82d5a3a5681a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.484017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907efc0-024e-4519-bbb6-82d5a3a5681a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.484291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907efc0-024e-4519-bbb6-82d5a3a5681a None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.484928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907efc0-024e-4519-bbb6-82d5a3a5681a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.486833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907efc0-024e-4519-bbb6-82d5a3a5681a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.493243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 501/1000] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:56 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:30:56.566278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08887e-d66d-411e-a104-dd893fe2eebc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:56.602656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d6d06-dbc3-4208-bab8-0f4257e974a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:56.603290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d6d06-dbc3-4208-bab8-0f4257e974a4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:56.603570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d6d06-dbc3-4208-bab8-0f4257e974a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:56.603842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d6d06-dbc3-4208-bab8-0f4257e974a4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:56.604494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d6d06-dbc3-4208-bab8-0f4257e974a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:56.605933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d6d06-dbc3-4208-bab8-0f4257e974a4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:56.618716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 500/1001] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:30:56 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:30:57.538126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9dc2b-31e9-42f8-91d0-fa828406eb92 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:57.538649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9dc2b-31e9-42f8-91d0-fa828406eb92 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:57.538728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9dc2b-31e9-42f8-91d0-fa828406eb92 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:57.540168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 502/1002] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:57.545448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3219e-f2d5-4a57-8268-ed6e4ab553b7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:57.545893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3219e-f2d5-4a57-8268-ed6e4ab553b7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:57.546126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3219e-f2d5-4a57-8268-ed6e4ab553b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:57.564647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-66f3219e-f2d5-4a57-8268-ed6e4ab553b7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:57.565861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-66f3219e-f2d5-4a57-8268-ed6e4ab553b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:57.634428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 501/1003] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:57.656572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9dc2b-31e9-42f8-91d0-fa828406eb92 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:57.760938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9dc2b-31e9-42f8-91d0-fa828406eb92 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:57.794954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c3c6d-9a9f-4b9d-b64e-a36a4b5414ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:57.795504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3c6d-9a9f-4b9d-b64e-a36a4b5414ba None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:57.795787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3c6d-9a9f-4b9d-b64e-a36a4b5414ba None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:57.796062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3c6d-9a9f-4b9d-b64e-a36a4b5414ba None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:57.796759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c3c6d-9a9f-4b9d-b64e-a36a4b5414ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:57.798169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c3c6d-9a9f-4b9d-b64e-a36a4b5414ba None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:57.813700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 503/1004] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:30:57 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:58.503539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9c71-3d3a-4879-88de-b4f95583c955 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.503869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9c71-3d3a-4879-88de-b4f95583c955 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.504107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9c71-3d3a-4879-88de-b4f95583c955 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.505618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 502/1005] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:58.510577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf086c2-528a-4089-959e-1479cc7ea85e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.510875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf086c2-528a-4089-959e-1479cc7ea85e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.511155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf086c2-528a-4089-959e-1479cc7ea85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.528890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9cf086c2-528a-4089-959e-1479cc7ea85e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:58.530130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9cf086c2-528a-4089-959e-1479cc7ea85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:58.545190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:58.611119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 504/1006] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:58 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:58.633576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9c71-3d3a-4879-88de-b4f95583c955 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:58.636551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:58.652888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1c7b-f2e5-40dc-9909-b96fefa93fdb None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.653173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1c7b-f2e5-40dc-9909-b96fefa93fdb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.653457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1c7b-f2e5-40dc-9909-b96fefa93fdb None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.654853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 505/1007] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:30:58.659778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.660096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.660384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.679403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:58.680593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:58.752414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9c71-3d3a-4879-88de-b4f95583c955 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:58.753091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 506/1008] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:58 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:30:58.775451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:58.791842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:58.792486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.792775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.793051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.793726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:58.795101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:58.804624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:58.805645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 29 04:30:58.806556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:30:58.810714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 503/1009] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 29 04:30:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:30:58.811502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:58.873915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:58.889320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:58.903185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584f9c-4b46-434f-80a4-b63312a637b9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:58.937449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873f4fe-22cb-4e30-b2e4-fae50af0c36e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:58.950905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:58.951628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.952022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.952318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.952956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:58.954441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:30:58.963632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:30:58.964661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:30:58.965543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 507/1010] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:30:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:30:58.971917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:58.979869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:58.980572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:58.980928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:58.981271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:58.982059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:58.982437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:58.983871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:58.989846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 504/1011] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:58.995114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:59.076828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d4d6-b5db-49d5-a8b7-fb68fc10bfc7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:59.100570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7f0e-2e33-4d23-ba24-d2efaff509eb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:59.109394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:59.110039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.110329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.111160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.111844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:59.112154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:59.113528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:59.118301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 508/1012] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:30:59.123937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:59.126492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:59.132442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:59.140239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:59.140852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.141130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.141401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.142612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:59.142914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:59.144369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:59.153919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 505/1013] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 29 04:30:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:59.154792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:59.241612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aede17-58d0-43fb-bb73-255e1f805ea2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:59.270863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3be64-9c21-44b0-82df-88bae01a655d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:59.279581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:59.280211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.280503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.280782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.281462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:30:59.281805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:59.283814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:59.288590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 509/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 29 04:30:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:30:59.294344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:30:59.312168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553e95-32ed-49a5-b0cb-87219c87dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:59.312883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553e95-32ed-49a5-b0cb-87219c87dfff None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.313241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553e95-32ed-49a5-b0cb-87219c87dfff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.313605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553e95-32ed-49a5-b0cb-87219c87dfff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.314415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35553e95-32ed-49a5-b0cb-87219c87dfff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:59.315847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35553e95-32ed-49a5-b0cb-87219c87dfff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:59.333127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 506/1015] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:30:59.375981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:30:59.417405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf0317-852f-417a-b765-c2d724301ab7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:30:59.465084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8197e4-eafb-4fdf-a98d-72d7e8e03ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:30:59.465934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8197e4-eafb-4fdf-a98d-72d7e8e03ef7 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.466322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8197e4-eafb-4fdf-a98d-72d7e8e03ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.466705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8197e4-eafb-4fdf-a98d-72d7e8e03ef7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.467534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8197e4-eafb-4fdf-a98d-72d7e8e03ef7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:30:59.469024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8197e4-eafb-4fdf-a98d-72d7e8e03ef7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:30:59.494217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 510/1016] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:30:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:30:59.826626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9147c0b-9d18-41fe-9150-fc8f619d4fa0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.827143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9147c0b-9d18-41fe-9150-fc8f619d4fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.827221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9147c0b-9d18-41fe-9150-fc8f619d4fa0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.828551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 507/1017] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:30:59.834233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:30:59.834661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:30:59.834841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:30:59.852591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:30:59.853810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:30:59.929021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 511/1018] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:30:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:30:59.950219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9147c0b-9d18-41fe-9150-fc8f619d4fa0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:00.008453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:00.058420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9147c0b-9d18-41fe-9150-fc8f619d4fa0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:00.093498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:00.094093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:00.094376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:00.094653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] PATH_INFO: `/v3/services/image` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:00.095332 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:00.096700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:00.105815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:00.106811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:00.113115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 508/1019] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Jul 29 04:30:59 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:00.113936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:00.158400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:00.213864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c4383-4b35-43bb-a1c8-b52f0d616d5d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:00.247872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:00.248497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:00.248782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:00.249061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:00.249767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] RBAC: Adding query filter params (name=image) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:00.250078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:00.252060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:00.261652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 512/1020] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:00.262558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:00.374622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ce96b-6000-4b06-a9c5-4f6562a1e02c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:00.392460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:00.415448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:00.416076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:00.416618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:00.416897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:00.417571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:00.417901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:00.419350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:00.432383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 509/1021] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:00.433698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:00.539558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aede902-2c03-4f60-9169-1b3a62f8757e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:00.554017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:00.581986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:00.582766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:00.583227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:00.583607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:00.584510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] RBAC: Adding query filter params (interface=public, service_id=7fd44bea481a46e798169c753622a6f1, region_id=RegionOne) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:00.584929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:00.586494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b0202-d0c7-4d24-bc64-50483668e3f6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:00.593640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 513/1022] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:31:00 2022] GET /identity/v3/endpoints?service_id=7fd44bea481a46e798169c753622a6f1&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:00.597812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:00.720464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86abe45-ba8e-45a1-861f-ad81b7da42a3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:00.755764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8821-64d9-4ac2-97d3-0c74e1166dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:00.756387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8821-64d9-4ac2-97d3-0c74e1166dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:00.756682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8821-64d9-4ac2-97d3-0c74e1166dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:00.756961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8821-64d9-4ac2-97d3-0c74e1166dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:00.757625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c8821-64d9-4ac2-97d3-0c74e1166dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:00.758999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c8821-64d9-4ac2-97d3-0c74e1166dd2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:00.769668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 510/1023] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:31:00 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:31:01.363015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91c5c-f582-4b98-9fc1-240de2b08b4f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.363540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91c5c-f582-4b98-9fc1-240de2b08b4f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.363540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91c5c-f582-4b98-9fc1-240de2b08b4f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.364947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 514/1024] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:01.369999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1cda-69be-4d71-8a96-b2b5cdb058c4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.370406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1cda-69be-4d71-8a96-b2b5cdb058c4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.370570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1cda-69be-4d71-8a96-b2b5cdb058c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.389500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d09f1cda-69be-4d71-8a96-b2b5cdb058c4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:01.390740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d09f1cda-69be-4d71-8a96-b2b5cdb058c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:01.434843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:01.460963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 511/1025] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:01.483818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91c5c-f582-4b98-9fc1-240de2b08b4f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:01.588725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91c5c-f582-4b98-9fc1-240de2b08b4f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:01.623159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:01.623721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.624007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.624284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.625439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:01.627456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:01.634219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 515/1026] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:01.635073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:01.635547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f6971-5fa5-4e68-ace2-5ad433685fd5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.635838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f6971-5fa5-4e68-ace2-5ad433685fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.636172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f6971-5fa5-4e68-ace2-5ad433685fd5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.637664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 512/1027] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:01.642562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.642848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.643125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.661979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:01.663178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:01.686049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:01.738115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 513/1028] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:31:01.753451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407406-49dd-4026-8169-e1234970b987 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:01.761245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:01.791725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:01.792347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.792628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.792900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.793623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:01.795055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:01.825060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 516/1029] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:31:01 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:31:01.874834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426afdd-07b8-4554-972b-500f6d5a9b2b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:01.883797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:01.914895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:01.915564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:01.915848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:01.916127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:01.932929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:01.940858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:01.942013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:31:01.942842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:01.944757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 514/1030] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 29 04:31:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:01.946322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.047885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:02.057902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25caa7-de59-4797-aa0a-80314c02d2c1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:02.091000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:02.091630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.091912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.092189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.092896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:02.093200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:02.094603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:02.103079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 517/1031] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:31:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:02.108788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.209560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462181f-d87f-486e-a23c-d9b4d68d6c3c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:02.243221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:02.243949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.244238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.244517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.254771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:02.256216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:02.271502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:02.272385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:02.273876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:02.273876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:02.273876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:02.273876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:02.273876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 515/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:02.278276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.379635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f312-d060-4d78-b1ee-e06f758ab85e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:02.414265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:02.414890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.415177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.415455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.416152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:02.416713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:02.418118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:02.434359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 518/1033] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:02.436124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.456613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:02.541154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b2b8-758e-47a6-9bec-76fee6a4a6dd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:02.575313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:02.575956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.576269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.576522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.585643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:02.587104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:31:02.598610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:02.599552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:02.605199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 516/1034] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:31:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:02.607509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.623406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:02.710392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ba8a-fcf9-467d-b125-58725715369f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:02.743518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:02.744264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.744659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.745039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.745961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:02.746444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:02.747962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37165-dee6-4f40-9cd1-ef47d28d66b9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:02.770536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 519/1035] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:31:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:02.772104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.847030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4073b-bc7c-4147-a4ed-899dc97b473b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.847311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4073b-bc7c-4147-a4ed-899dc97b473b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.847566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4073b-bc7c-4147-a4ed-899dc97b473b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.849092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 520/1036] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:31:02.853963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.854256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.854538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.855164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:02.874080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:02.875286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:02.884832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569d85-0afc-4c9d-a515-9c7944ca752d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:02.921131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:02.921933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:02.922320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:02.922721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:02.961734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 521/1037] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:31:02.978446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:02.980750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.002403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.003906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.084472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb136f4-7738-423a-a811-b6356255ff7b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.086650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.117762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 517/1038] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:02 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:03.118674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.126972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.127630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.127914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.128191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] PATH_INFO: `/v3/services/image` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.129198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.130911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:03.139862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:03.140831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 29 04:31:03.141852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:03.146267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 522/1039] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Jul 29 04:31:02 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:03.147125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.220186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.234593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c373f-473b-4867-9be3-164e8c7e78da None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.260258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d3631-c4a5-4663-946c-0a25f94e2e0f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.272762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.273440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.273760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.274038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.284812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.286394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.299925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.300614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.300966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.301306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:03.301826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:03.302876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:03.303780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:03.303780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:03.303780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:03.303780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:03.304013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:03.304083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 518/1040] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:03.305736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.307127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.308850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.313311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 523/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:03.318828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.346165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.420308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374342ed-ca11-43f3-bbb6-09fb814412c2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.425077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388b39e-576f-4d22-a768-affd40557fd7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.455563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.456459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.457195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.457633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.457945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.458683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:03.459053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.460398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.463030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.463643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.463923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.464193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.464860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:03.465163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.466533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.477426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 524/1042] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:03.477638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 519/1043] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:03.479339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.480862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.580731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.591205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184372-78e8-4e64-91d7-3a4428b379d8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.592532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ac6d-59d0-4203-8129-03dda0394b11 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.627496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.628109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.628389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.628663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.628757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.629368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.629612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.630003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.630377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.630767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.637468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.639050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.657860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 525/1044] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:31:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:31:03.658100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:03.659418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:03.660503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 520/1045] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:03.661103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.716714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:03.783189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef806fc0-1839-44ec-b31b-76487164d30e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.820242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.821219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.821611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.821997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.822857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:03.823266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.824776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66835285-9d93-4508-8790-4858b7cefdb5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:03.838798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 526/1046] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:03.846156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:03.897331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777e72-6859-4ff1-b713-0d4ba4e7396e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.897647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777e72-6859-4ff1-b713-0d4ba4e7396e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.897930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777e72-6859-4ff1-b713-0d4ba4e7396e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.899319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 527/1047] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:31:03.904746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.905030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.905306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.924167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:03.925371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:03.958124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025f17-bd4a-42d3-9fc6-e24c4e0e3ede None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:03.993555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:03.994218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:03.994498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:03.994771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:03.995554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] RBAC: Adding query filter params (role.id=f770356edf23411f95eac2700c40a031, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=2919227b992743178d0128981ad54c6b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:03.995863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:03.997295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:04.000755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 528/1048] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:31:04.005634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 521/1049] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:03 2022] GET /identity/v3/role_assignments?user.id=2919227b992743178d0128981ad54c6b&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=f770356edf23411f95eac2700c40a031 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:04.025096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:04.065216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:04.135973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd0f93-b7eb-4c36-aff7-3cbbb6ac4b89 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:04.174224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673cb33-44f4-4282-87fe-25333016dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:04.174864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673cb33-44f4-4282-87fe-25333016dc72 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:04.175143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673cb33-44f4-4282-87fe-25333016dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:04.175412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673cb33-44f4-4282-87fe-25333016dc72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:04.176553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673cb33-44f4-4282-87fe-25333016dc72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:04.178026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673cb33-44f4-4282-87fe-25333016dc72 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:04.184332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 529/1050] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:04.185269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:04.202009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:04.292970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08da71-d266-434a-8b39-686edcec129e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:04.326239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b429ae-d860-4976-8a8d-38dbdb76385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:04.326860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b429ae-d860-4976-8a8d-38dbdb76385e None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:04.327141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b429ae-d860-4976-8a8d-38dbdb76385e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:04.327414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b429ae-d860-4976-8a8d-38dbdb76385e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:04.328099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b429ae-d860-4976-8a8d-38dbdb76385e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:04.330109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b429ae-d860-4976-8a8d-38dbdb76385e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:04.361628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 522/1051] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:31:04 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:05.742820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba8a0d-2e03-4ccc-b014-7c24a4fe6fce None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:05.743344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba8a0d-2e03-4ccc-b014-7c24a4fe6fce None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:05.743444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba8a0d-2e03-4ccc-b014-7c24a4fe6fce None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:05.744759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 530/1052] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:05.749891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c292-f094-43b3-9d06-b0e21ea58b89 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:05.750267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c292-f094-43b3-9d06-b0e21ea58b89 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:05.750462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48c292-f094-43b3-9d06-b0e21ea58b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:05.768467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-de48c292-f094-43b3-9d06-b0e21ea58b89 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:05.769686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de48c292-f094-43b3-9d06-b0e21ea58b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:05.832523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:05.839348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 523/1053] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:05.862067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba8a0d-2e03-4ccc-b014-7c24a4fe6fce None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:05.978750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba8a0d-2e03-4ccc-b014-7c24a4fe6fce None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:05.980937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010751-f621-4efc-8da4-20b11d444a74 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:05.981385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:05.982194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010751-f621-4efc-8da4-20b11d444a74 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:05.982572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010751-f621-4efc-8da4-20b11d444a74 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:05.984251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 524/1054] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:31:05.990676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:05.990971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:05.991421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.009295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:06.010446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:06.017691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.018322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.018603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.018878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.083782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 525/1055] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:31:06.090915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.092368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.106121 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.199323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 531/1056] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:06.205928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.208641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:06.212344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda882f-d1ab-45e0-8147-4deb41a8806d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.247375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:06.256011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.257132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.257411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.257994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.274413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:06.281629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:06.283378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:06.284239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 526/1057] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:06.289316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.315487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e38389-ef42-479c-9af1-93a14fd9c72e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.353140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.353816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.354100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.354375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.365014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.366612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9e5cb5b2-d9a2-423c-bcda-51a5607c0b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:06.382759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:06.383857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:06.384864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:06.384864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:06.384864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:06.384864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:06.391091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 532/1058] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:06.391091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e29d3-392e-452a-a6c1-0717d0a48a41 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.391091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e29d3-392e-452a-a6c1-0717d0a48a41 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.391091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e29d3-392e-452a-a6c1-0717d0a48a41 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.391091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 533/1059] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:06.392748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e29d3-392e-452a-a6c1-0717d0a48a41 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.393968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f682-3f0e-4753-8cf9-1c3f49fe7c8f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.427377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.427991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.428274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.428547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.429251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:06.429555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.430944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc32acc-f86d-448c-9e79-feccf7747d4c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.439520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 527/1060] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:06.440662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.440959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.441247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.451420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:06.459039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:06.460228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:06.496002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e29d3-392e-452a-a6c1-0717d0a48a41 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.506903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:06.527678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 528/1061] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:06.528421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.536932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.537552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.537864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.538137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.538821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:06.539125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.540497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.552594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 534/1062] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:06.553410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.650967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244ebf-7a7c-4d4c-b3b6-dc5fde79d874 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.669481 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3075801-4bcd-4a2d-8d38-caa7b33582e2 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.689377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:06.697142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.697831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.698118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.698988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.710458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.711406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.711926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.713258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.713258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.713441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.727411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:06.729219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:06.730135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:06.731025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:06.731025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:06.731025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:06.731025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:06.731025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 529/1063] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:06.732501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:06.733371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:06.735800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 535/1064] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:06.736563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.742636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.776631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:06.852956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7fce-66bf-48f0-b220-3a4ec42d8250 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.855430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627da53d-097d-427d-aa02-8b199ef7499d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:06.887778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.888394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.888678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.888818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:06.888953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.889433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:06.889694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:06.889805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:06.890031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.890128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:06.890710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:06.891025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:06.891439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.892403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:06.899594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 536/1065] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:06.904171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 530/1066] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:06.905368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.909321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:06.946104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.004150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.006823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4d0eb-0857-49a4-8cb5-1c359c603b6c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.011041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6955f2-5084-44df-b7d3-e0abe40c9138 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.040037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.040678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.040963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.041497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] PATH_INFO: `/v3/users/f557e3bee288447aa45a119a721d9b82` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.045620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.046292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.046573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.046847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.054250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.054866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] RBAC: Authorizing `identity:get_user(user_id=f557e3bee288447aa45a119a721d9b82)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.055684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.056271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.057930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 537/1067] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/users/f557e3bee288447aa45a119a721d9b82 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:07.063512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:31:07.067664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:07.068691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:07.069882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 531/1068] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:31:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:07.074484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.152999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.159824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428816-6751-478f-a475-4e458baf0fec None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.176109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6fec9-14eb-4fd4-9f4c-0988aa6d0a87 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.193816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.194435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.194723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.195002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.209111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.209750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.210033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.210308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.211091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:07.211398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.212825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.229939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 532/1069] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:07.236376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.250080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.261113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.262703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.339190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13953961-6fa3-417f-9d03-ec22cb2720cb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.358156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.366375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 538/1070] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 04:31:07.372088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.377892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.378537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.378823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.379422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.389000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.390543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:07.405379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:07.406421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:07.412657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:07.412657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:07.412657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:07.412657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:07.412657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 533/1071] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:07.412955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.469620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce9e1-eaa0-4f3c-b2d8-cc0f26818558 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.473440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.502954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.503586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.503868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.504148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.505295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] RBAC: Authorizing `identity:get_project(project_id=07dcf6f36b3544a993367834015ca7c8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.506797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.508463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 539/1072] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:07.514464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.515658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d653d9-f9c4-4a4c-b701-fb29541a4d8d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.551443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.552056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.552338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.552611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.553283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:07.553585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.554967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.566737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 534/1073] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:07.572298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.576991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.615327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412cbf-2a9d-49f2-a2c5-f82d5ffaaf32 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.656379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.656940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.657892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.658174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.658956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=07dcf6f36b3544a993367834015ca7c8, user.id=f557e3bee288447aa45a119a721d9b82) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:07.659267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.660822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.666471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 540/1074] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/role_assignments?user.id=f557e3bee288447aa45a119a721d9b82&scope.project.id=07dcf6f36b3544a993367834015ca7c8&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:07.675001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b17e4-4f03-461e-9a87-06de611e27db None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.703363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.715690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.716350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.716628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.716901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.725038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.726536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:31:07.738562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:07.739618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:07.740509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 535/1075] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:07.745847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:07.846330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468e8e-f258-4cdc-bdfb-4b873e1e9de7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:07.870921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:07.879881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:07.880503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:07.880787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:07.881067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:07.881838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:07.882152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:07.883609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0b40-44a9-4f57-b50d-94a0206aae1f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:07.896009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 541/1076] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:07.901956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:08.004885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d5f7-3f26-4c5b-939b-f8d5020eace7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:08.038724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d0c61-33b2-4b98-b7bc-2acaac072e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:08.039555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0c61-33b2-4b98-b7bc-2acaac072e83 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:08.039693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0c61-33b2-4b98-b7bc-2acaac072e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:08.039931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d0c61-33b2-4b98-b7bc-2acaac072e83 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/2919227b992743178d0128981ad54c6b/roles/f770356edf23411f95eac2700c40a031` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:08.043581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0c61-33b2-4b98-b7bc-2acaac072e83 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=2919227b992743178d0128981ad54c6b, role_id=f770356edf23411f95eac2700c40a031)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:08.045024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d0c61-33b2-4b98-b7bc-2acaac072e83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:08.058210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 536/1077] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:31:07 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/2919227b992743178d0128981ad54c6b/roles/f770356edf23411f95eac2700c40a031 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:31:09.653177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812189-8ba4-48cc-9bc8-ae8ca84da51e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:09.653936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812189-8ba4-48cc-9bc8-ae8ca84da51e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:09.653936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812189-8ba4-48cc-9bc8-ae8ca84da51e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:09.655195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 542/1078] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:09.660453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:09.660885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:09.660984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:09.679379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:09.680562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:09.718950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:09.746123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 537/1079] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:09.768197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e812189-8ba4-48cc-9bc8-ae8ca84da51e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:09.868056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e812189-8ba4-48cc-9bc8-ae8ca84da51e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:09.900913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991d67a-0dff-4199-a61d-3f75cc47f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:09.901563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d67a-0dff-4199-a61d-3f75cc47f15f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:09.901882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d67a-0dff-4199-a61d-3f75cc47f15f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:09.902157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d67a-0dff-4199-a61d-3f75cc47f15f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:09.912256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991d67a-0dff-4199-a61d-3f75cc47f15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-2991d67a-0dff-4199-a61d-3f75cc47f15f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:09.917423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:09.918617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:09.919561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 543/1080] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:09.925090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.025351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0d0a-29d5-4675-ba37-deeb4a1bc828 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.048299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723772-19e0-4fa3-b47f-9410c8bbd37e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.048585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723772-19e0-4fa3-b47f-9410c8bbd37e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.048868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723772-19e0-4fa3-b47f-9410c8bbd37e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.050375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 544/1081] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:31:10.054873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f2362-4bda-4623-838e-542175c84a19 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.055161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f2362-4bda-4623-838e-542175c84a19 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.055437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f2362-4bda-4623-838e-542175c84a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.058935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.059549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.059827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.060098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.060799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:10.061099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.062682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.076592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 538/1082] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:10.076773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-948f2362-4bda-4623-838e-542175c84a19 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:10.076773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-948f2362-4bda-4623-838e-542175c84a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:10.077547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.112526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:10.119811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:10.143211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 545/1083] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:31:10.166421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f2362-4bda-4623-838e-542175c84a19 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.180463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74027b59-79e6-4854-9fac-b772c51d40f7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.213366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.214029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.214308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.214608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] PATH_INFO: `/v3/users/f557e3bee288447aa45a119a721d9b82` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.215768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] RBAC: Authorizing `identity:get_user(user_id=f557e3bee288447aa45a119a721d9b82)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.217185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.218810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 539/1084] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/users/f557e3bee288447aa45a119a721d9b82 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:10.224953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.265678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f2362-4bda-4623-838e-542175c84a19 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.300765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.301409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.301776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.302057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.312169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:10.317080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:10.318035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:10.318873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 546/1085] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:10.322177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d0295-d894-4dc2-9c12-ced954ae7141 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.324086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.324574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:10.356677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.357321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.357624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.357899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.359047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] RBAC: Authorizing `identity:get_project(project_id=07dcf6f36b3544a993367834015ca7c8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.361028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.362717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 540/1086] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:10.364759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:10.369068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.424773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111db8e-059e-4cfd-92cd-c424b12e03b5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.456970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.457590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.457902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.458195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.458903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:10.459210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.460587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.468541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 547/1087] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:10.470754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ca4f-000d-4f8f-85c0-c846ab2e4d88 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.474642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.503880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.504531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.504815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.505087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8/users/f557e3bee288447aa45a119a721d9b82/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.507051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] RBAC: Authorizing `identity:create_grant(project_id=07dcf6f36b3544a993367834015ca7c8, user_id=f557e3bee288447aa45a119a721d9b82, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.508475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.522060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 541/1088] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:31:10 2022] PUT /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8/users/f557e3bee288447aa45a119a721d9b82/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:31:10.581828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:10.584998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5ffc-8777-4f52-a103-6b77dc51a950 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.621810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.622476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.622760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.623036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.634804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.636283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:10.653991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:10.655603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:10.656494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:10.656494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:10.656494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:10.656494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:10.656494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 548/1089] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:10.662575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.697070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:10.767501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520c6f4-08d0-4d63-9619-43b0867cd16c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.800009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.800622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.800899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.801169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.801864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:10.802163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.803519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.815687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 542/1090] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:10.821347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:10.917887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f52bf-720b-4077-a5e8-c22d946c571a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:10.951361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:10.951933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:10.952217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:10.952493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:10.960581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:10.962052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:31:10.973309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:10.974511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:10.975619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 549/1091] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:10.980170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:11.068706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:11.078046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5628-a7a3-45a1-92da-2997c004b757 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:11.111142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:11.111748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:11.112025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:11.112297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:11.113071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:11.113377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:11.114828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:11.131890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 543/1092] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 29 04:31:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:11.137642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:11.153110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:11.237194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b05f-9f06-40be-bc5b-084f1fb1d67d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:11.269366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:11.270180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:11.270468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:11.270741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:11.334279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:11.335715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:11.348503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:11.429382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 550/1093] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 04:31:11.435201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:11.532926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc73be6-ac4a-4091-8df2-1a8a53a3bf9e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:11.570229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:11.570873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:11.571156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:11.571433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:11.581384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:11.582860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:11.597715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:11.598624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:11.599523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:31:11.599523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:11.599523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:31:11.599523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:11.599523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 544/1094] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:11.604600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:11.709983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8dc53-9bc3-47a9-8350-4842156540e9 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:11.723293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:11.744612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:11.745228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:11.745515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:11.745835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:11.746526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:11.746830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:11.748192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:11.759178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 551/1095] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:11.765039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:11.767936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:11.864757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3861-153a-4734-9cc7-d9d2c7ceb787 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:11.898383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:11.899015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:11.899299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:11.899574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:11.906284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:11.908301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:31:11.919879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:11.920901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:11.921952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 545/1096] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:11.926821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:12.028912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059fc9f-2827-455f-9755-f32e0bf94f57 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:12.061567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:12.062321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:12.062603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:12.062880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:12.063661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:12.063966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:12.065378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeb926-8f9f-4afd-b99b-d935d34340f4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:12.076986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 552/1097] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:12.083626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:12.144677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:12.183815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c900607-b3d8-4dbf-b381-dbe366f8971d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:12.217269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:12.217914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:12.218205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:12.218481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:12.219260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] RBAC: Adding query filter params (role.id=f770356edf23411f95eac2700c40a031, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=2919227b992743178d0128981ad54c6b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:12.220119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:12.221543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b3c5-33f9-41da-a6c3-26a2a1afc4ff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:12.227266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 546/1098] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:12 2022] GET /identity/v3/role_assignments?user.id=2919227b992743178d0128981ad54c6b&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=f770356edf23411f95eac2700c40a031 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:12.503061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8da37-a880-4604-8bd1-1042677735df None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:12.503358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8da37-a880-4604-8bd1-1042677735df None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:12.503636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8da37-a880-4604-8bd1-1042677735df None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:12.504995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 553/1099] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:12.510266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:12.510559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:12.510841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:12.528622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:12.529825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:12.600216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 547/1100] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:12.623018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8da37-a880-4604-8bd1-1042677735df None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:12.654867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:12.729365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8da37-a880-4604-8bd1-1042677735df None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:12.763930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:12.764501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:12.764789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:12.765067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:12.775747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:12.780662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:12.781633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:12.783120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 554/1101] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:12.788559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:12.847310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:12.891938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344db60-70da-46e5-bd20-8567ef2082a5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:12.927686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:12.928360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:12.928662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:12.928970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:12.929708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:12.930020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:12.931533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:12.940037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 548/1102] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:12.946801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:13.040206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:13.049681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151c4d-eb3e-4020-a1ea-5fb3718f005a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:13.083373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:13.084007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:13.084289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:13.084565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] PATH_INFO: `/v3/users/f557e3bee288447aa45a119a721d9b82` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:13.085747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] RBAC: Authorizing `identity:get_user(user_id=f557e3bee288447aa45a119a721d9b82)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:13.087188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:13.088783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 555/1103] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:12 2022] GET /identity/v3/users/f557e3bee288447aa45a119a721d9b82 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:13.094689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:13.190081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc6b2b-a9db-44c1-9f90-cf1282de2cda None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:13.206472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:13.222953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:13.223557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:13.223836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:13.224113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:13.287660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:13.289089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:13.383708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 549/1104] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:13.389482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:13.484778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aad57-073e-43e3-849c-a8a89b6d5da0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:13.517345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c03e2-a65a-468e-8b69-452242939754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:13.517987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c03e2-a65a-468e-8b69-452242939754 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:13.518269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c03e2-a65a-468e-8b69-452242939754 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:13.518542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c03e2-a65a-468e-8b69-452242939754 None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:13.519672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c03e2-a65a-468e-8b69-452242939754 None admin] RBAC: Authorizing `identity:get_project(project_id=07dcf6f36b3544a993367834015ca7c8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:13.521087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c03e2-a65a-468e-8b69-452242939754 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:13.522733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 556/1105] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:13 2022] GET /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:13.528801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:13.546606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:13.625528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185c73b-fffd-48f4-b809-14cd1b07f087 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:13.658203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:13.658746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:13.659026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:13.659301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:13.660070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=07dcf6f36b3544a993367834015ca7c8, user.id=f557e3bee288447aa45a119a721d9b82) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:13.660402 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:13.661855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b712341-6c86-462a-bb28-d5764af4a632 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:13.667678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 550/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:13 2022] GET /identity/v3/role_assignments?user.id=f557e3bee288447aa45a119a721d9b82&scope.project.id=07dcf6f36b3544a993367834015ca7c8&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:15.662460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37818d38-0c73-4f09-bfe8-3b50193e49c7 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:15.663051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37818d38-0c73-4f09-bfe8-3b50193e49c7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:15.663051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37818d38-0c73-4f09-bfe8-3b50193e49c7 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:15.664378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 557/1107] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:15.669836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:15.670230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:15.670385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:15.687839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:15.689019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:15.752801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 551/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:15.777063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37818d38-0c73-4f09-bfe8-3b50193e49c7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:15.804899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:15.875807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37818d38-0c73-4f09-bfe8-3b50193e49c7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:15.908967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69f381-834e-4b74-96e6-a2bf7678b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:15.909616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69f381-834e-4b74-96e6-a2bf7678b379 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:15.909905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69f381-834e-4b74-96e6-a2bf7678b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:15.910180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69f381-834e-4b74-96e6-a2bf7678b379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:15.911317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69f381-834e-4b74-96e6-a2bf7678b379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:15.912787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69f381-834e-4b74-96e6-a2bf7678b379 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:15.914334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 558/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:15.920494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:15.938297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:16.021300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906230ba-3d2b-4d55-a708-59efa39638bb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:16.054495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320d3c-7d2b-4358-b1a6-05b92c8889c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:16.055110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320d3c-7d2b-4358-b1a6-05b92c8889c9 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:16.055390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320d3c-7d2b-4358-b1a6-05b92c8889c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:16.055665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320d3c-7d2b-4358-b1a6-05b92c8889c9 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:16.056335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4320d3c-7d2b-4358-b1a6-05b92c8889c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:16.057785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4320d3c-7d2b-4358-b1a6-05b92c8889c9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:16.078037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 552/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:31:15 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:18.056622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc4a7d-267b-4853-ac55-1981394ddaeb None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:18.057151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc4a7d-267b-4853-ac55-1981394ddaeb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:18.057151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc4a7d-267b-4853-ac55-1981394ddaeb None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:18.058536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 559/1111] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:18.064470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:18.064978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:18.065082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:18.082788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:18.083962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:18.143288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:18.149260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 553/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:18.171686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc4a7d-267b-4853-ac55-1981394ddaeb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:18.266146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:18.273348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc4a7d-267b-4853-ac55-1981394ddaeb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:18.307076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:18.307711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:18.307996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:18.308275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] PATH_INFO: `/v3/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:18.309744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] RBAC: Authorizing `identity:get_role(role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:18.311110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:18.312440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 560/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:18 2022] GET /identity/v3/roles/95d5a16009d54ef398e385695bf7abcd => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:18.318320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:18.413886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273f0e-af12-4a3f-87d2-e694a1450a40 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:18.446872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:18.447501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:18.447785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:18.448064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] PATH_INFO: `/v3/users/ef6e156e851a4fbc9a9f3dc532457e90` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:18.460561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ef6e156e851a4fbc9a9f3dc532457e90)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:18.462047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:18.463638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 554/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:18 2022] GET /identity/v3/users/ef6e156e851a4fbc9a9f3dc532457e90 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:18.469810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:18.564868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199670ed-bad8-4cc8-a73c-feabac5d6698 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:18.606277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:18.606900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:18.607182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:18.607456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:18.637982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:18.674268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:18.675709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:18.768552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 561/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:18.774425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:18.829410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:18.871952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f98cb-253d-46d2-99ef-85cfea4da6d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:18.904623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fcfb9-b0cb-4bb0-86e4-d40b85a039e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:18.905252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcfb9-b0cb-4bb0-86e4-d40b85a039e1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:18.905536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcfb9-b0cb-4bb0-86e4-d40b85a039e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:18.905843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcfb9-b0cb-4bb0-86e4-d40b85a039e1 None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:18.907604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fcfb9-b0cb-4bb0-86e4-d40b85a039e1 None admin] RBAC: Authorizing `identity:get_project(project_id=07dcf6f36b3544a993367834015ca7c8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:18.909021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fcfb9-b0cb-4bb0-86e4-d40b85a039e1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:18.910688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 555/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:18 2022] GET /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:18.916909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:18.978314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:19.014738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9404e8-004e-492d-b51e-309b99e0d53f None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:19.049999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:19.050612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:19.050895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:19.051177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:19.051983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] RBAC: Adding query filter params (role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=07dcf6f36b3544a993367834015ca7c8, user.id=ef6e156e851a4fbc9a9f3dc532457e90) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:19.052294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:19.053749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2267434-9925-4a91-95cf-1cbdb811c0cf None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:19.058928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 562/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:18 2022] GET /identity/v3/role_assignments?user.id=ef6e156e851a4fbc9a9f3dc532457e90&scope.project.id=07dcf6f36b3544a993367834015ca7c8&role.id=95d5a16009d54ef398e385695bf7abcd => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:21.003599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013e23-e938-444f-99ac-c3a6b8179bf5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:21.004127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013e23-e938-444f-99ac-c3a6b8179bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:21.004127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013e23-e938-444f-99ac-c3a6b8179bf5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:21.005470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 556/1118] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:21.010653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:21.011049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:21.011219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:21.028735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:21.029970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:21.098727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 563/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:21.120780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1013e23-e938-444f-99ac-c3a6b8179bf5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:21.218450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1013e23-e938-444f-99ac-c3a6b8179bf5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:21.240953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:21.252781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:21.253410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:21.253723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:21.254003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] PATH_INFO: `/v3/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:21.255427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] RBAC: Authorizing `identity:get_role(role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:21.256792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:21.258146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 557/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:21 2022] GET /identity/v3/roles/95d5a16009d54ef398e385695bf7abcd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:21.263817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:21.324325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:21.364934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1652833-0a1f-4b2a-b6ea-90f0ac0e4f32 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:21.397033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:21.397693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:21.397978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:21.398256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] PATH_INFO: `/v3/users/ef6e156e851a4fbc9a9f3dc532457e90` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:21.399407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] RBAC: Authorizing `identity:get_user(user_id=ef6e156e851a4fbc9a9f3dc532457e90)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:21.400838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:21.402467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 564/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:21 2022] GET /identity/v3/users/ef6e156e851a4fbc9a9f3dc532457e90 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:21.408851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:21.504399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36845e77-d295-4f09-b64a-c033f79f90d3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:21.537040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc138c-484a-413c-ad63-27187f18eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:21.537690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc138c-484a-413c-ad63-27187f18eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:21.537975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc138c-484a-413c-ad63-27187f18eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:21.538254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc138c-484a-413c-ad63-27187f18eaeb None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:21.539404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc138c-484a-413c-ad63-27187f18eaeb None admin] RBAC: Authorizing `identity:get_project(project_id=07dcf6f36b3544a993367834015ca7c8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:21.540829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc138c-484a-413c-ad63-27187f18eaeb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:21.542758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 558/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:21 2022] GET /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:21.549411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:21.647563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b94dd-3405-4fb0-9b48-c5ddd16f60c7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:21.673643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:21.682455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdc57f-32c4-4cde-bc69-4855ac9c8231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:21.683122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdc57f-32c4-4cde-bc69-4855ac9c8231 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:21.683406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdc57f-32c4-4cde-bc69-4855ac9c8231 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:21.683683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdc57f-32c4-4cde-bc69-4855ac9c8231 None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8/users/ef6e156e851a4fbc9a9f3dc532457e90/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:21.685868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdc57f-32c4-4cde-bc69-4855ac9c8231 None admin] RBAC: Authorizing `identity:create_grant(project_id=07dcf6f36b3544a993367834015ca7c8, user_id=ef6e156e851a4fbc9a9f3dc532457e90, role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:21.687297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdc57f-32c4-4cde-bc69-4855ac9c8231 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:21.699129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 565/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:31:21 2022] PUT /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8/users/ef6e156e851a4fbc9a9f3dc532457e90/roles/95d5a16009d54ef398e385695bf7abcd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:31:23.671333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60277-4cc6-47b2-8d1f-858244fbfa2d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:23.671858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60277-4cc6-47b2-8d1f-858244fbfa2d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:23.671858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60277-4cc6-47b2-8d1f-858244fbfa2d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:23.673225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 559/1124] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:23.678513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:23.678939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:23.679068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:23.697074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:23.698275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:23.761746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 566/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:23.784958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60277-4cc6-47b2-8d1f-858244fbfa2d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:23.843062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:23.883712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60277-4cc6-47b2-8d1f-858244fbfa2d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:23.917199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:23.917853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:23.918137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:23.918411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] PATH_INFO: `/v3/roles/95d5a16009d54ef398e385695bf7abcd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:23.919838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] RBAC: Authorizing `identity:get_role(role_id=95d5a16009d54ef398e385695bf7abcd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:23.921206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:23.923115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 560/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:23 2022] GET /identity/v3/roles/95d5a16009d54ef398e385695bf7abcd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:23.928814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:24.023322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16950c8a-db7e-44aa-9d2b-e5ab32ae6b79 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:24.039484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:24.058251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:24.058880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:24.059161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:24.059434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] PATH_INFO: `/v3/users/ef6e156e851a4fbc9a9f3dc532457e90` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:24.060583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] RBAC: Authorizing `identity:get_user(user_id=ef6e156e851a4fbc9a9f3dc532457e90)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:24.062068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:24.064274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 567/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:23 2022] GET /identity/v3/users/ef6e156e851a4fbc9a9f3dc532457e90 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:24.070216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:24.164392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc750-c773-4340-93dd-1e3c891a5de7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:24.190627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:24.198406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:24.199004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:24.199285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:24.199557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:24.263538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:24.264969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:24.359444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 561/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:24.365927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:24.466249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01c17-b565-4046-a9b7-9ac60fd90c18 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:24.499150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdb388-c526-45f4-969d-79f4f6abb213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:24.499779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdb388-c526-45f4-969d-79f4f6abb213 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:24.500061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdb388-c526-45f4-969d-79f4f6abb213 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:24.500336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdb388-c526-45f4-969d-79f4f6abb213 None admin] PATH_INFO: `/v3/projects/07dcf6f36b3544a993367834015ca7c8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:24.501484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdb388-c526-45f4-969d-79f4f6abb213 None admin] RBAC: Authorizing `identity:get_project(project_id=07dcf6f36b3544a993367834015ca7c8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:24.502942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdb388-c526-45f4-969d-79f4f6abb213 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:24.504586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 568/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:24 2022] GET /identity/v3/projects/07dcf6f36b3544a993367834015ca7c8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:24.510784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:24.537578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:24.606848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4d18b-043c-419f-9e62-087f095f4273 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:24.639629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:24.640227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:24.640510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:24.640780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:24.642086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] RBAC: Adding query filter params (role.id=95d5a16009d54ef398e385695bf7abcd, scope.project.id=07dcf6f36b3544a993367834015ca7c8, user.id=ef6e156e851a4fbc9a9f3dc532457e90) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:24.642403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:24.643819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62c77a-66e9-4106-b3fc-ed30437889fc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:24.649489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 562/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:24 2022] GET /identity/v3/role_assignments?user.id=ef6e156e851a4fbc9a9f3dc532457e90&scope.project.id=07dcf6f36b3544a993367834015ca7c8&role.id=95d5a16009d54ef398e385695bf7abcd => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:26.632093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da276a-7ede-4a47-84e7-97bb837984b9 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:26.632622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da276a-7ede-4a47-84e7-97bb837984b9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:26.632622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da276a-7ede-4a47-84e7-97bb837984b9 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:26.634028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 569/1131] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:26.639311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:26.639695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:26.639903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:26.658291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:26.659479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:26.724291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 563/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:26.747444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da276a-7ede-4a47-84e7-97bb837984b9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:26.799645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:26.845585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da276a-7ede-4a47-84e7-97bb837984b9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:26.878622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319800a2-f8cc-4345-bf04-ee143c3e8ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:26.879279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319800a2-f8cc-4345-bf04-ee143c3e8ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:26.879566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319800a2-f8cc-4345-bf04-ee143c3e8ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:26.879844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319800a2-f8cc-4345-bf04-ee143c3e8ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:26.881047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319800a2-f8cc-4345-bf04-ee143c3e8ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:26.882560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319800a2-f8cc-4345-bf04-ee143c3e8ce4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:26.884085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 570/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:26.889746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:26.913494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:26.986676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a1fac-8936-4a2b-8ce1-04a60b74276c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:27.019058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9cd5c-1c9a-47e5-8ccc-ad9e7a68d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:27.019665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cd5c-1c9a-47e5-8ccc-ad9e7a68d969 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:27.019948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cd5c-1c9a-47e5-8ccc-ad9e7a68d969 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:27.020223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cd5c-1c9a-47e5-8ccc-ad9e7a68d969 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:27.020895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9cd5c-1c9a-47e5-8ccc-ad9e7a68d969 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:27.022352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9cd5c-1c9a-47e5-8ccc-ad9e7a68d969 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:27.047901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 564/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:31:26 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:29.058178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f580-fd1a-45d9-9368-bffc685e930c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:29.058730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f580-fd1a-45d9-9368-bffc685e930c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:29.058730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f580-fd1a-45d9-9368-bffc685e930c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:29.060109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 571/1135] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:29.065703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:29.066067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:29.066271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:29.084577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:29.085813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:29.151614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 565/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:29.176203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f580-fd1a-45d9-9368-bffc685e930c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:29.273990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f580-fd1a-45d9-9368-bffc685e930c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:29.293353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:29.307595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6d5d-7782-462e-9a4d-8f0343ee43bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:29.308224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d5d-7782-462e-9a4d-8f0343ee43bd None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:29.308510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d5d-7782-462e-9a4d-8f0343ee43bd None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:29.308788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d5d-7782-462e-9a4d-8f0343ee43bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:29.309964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6d5d-7782-462e-9a4d-8f0343ee43bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:29.311395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6d5d-7782-462e-9a4d-8f0343ee43bd None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:29.312959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 572/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:31:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:29.319098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:29.322176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:29.424444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bf275-4987-46c3-adb6-622f922202f8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:29.457616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f20e-81e3-4e93-aba3-9265358167e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:29.458236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f20e-81e3-4e93-aba3-9265358167e1 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:29.458521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f20e-81e3-4e93-aba3-9265358167e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:29.458798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f20e-81e3-4e93-aba3-9265358167e1 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:29.459473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f20e-81e3-4e93-aba3-9265358167e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:29.460909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f20e-81e3-4e93-aba3-9265358167e1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:29.481417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 566/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:31:29 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:31.501223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05252a61-3f32-411b-9b4c-14850294a507 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:31.501809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05252a61-3f32-411b-9b4c-14850294a507 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:31.501900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05252a61-3f32-411b-9b4c-14850294a507 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:31.503281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 573/1139] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:31.508440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:31.508856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:31.509000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:31.527024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:31.528205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:31.583448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:31.595892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 567/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:31.618650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05252a61-3f32-411b-9b4c-14850294a507 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:31.717110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05252a61-3f32-411b-9b4c-14850294a507 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:31.749729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:31.750356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:31.751198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:31.751563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:31.761121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:31.766104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:31.767661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:31.768632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 574/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:31:31.773900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:31.868392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc318668-f2d6-404a-810d-9824dec441c7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:31.901485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:31.902116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:31.902400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:31.902678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:31.903383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:31.903692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:31.905050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:31.912769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 568/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:31.918674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:31.966640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:32.014565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bb2f-cae9-4f47-acae-6a958277ccc7 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:32.046819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:32.047458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:32.047739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:32.048012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] PATH_INFO: `/v3/users/37f3b15b06a6409483f92c49b1d39919` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:32.060883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] RBAC: Authorizing `identity:get_user(user_id=37f3b15b06a6409483f92c49b1d39919)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:32.062344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:32.064446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 575/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:31 2022] GET /identity/v3/users/37f3b15b06a6409483f92c49b1d39919 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:32.070344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:32.121135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:32.167396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fee21-8a29-4693-b5c4-d769ee390259 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:32.200516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:32.201122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:32.201409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:32.201722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:32.266996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:32.268405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:32.317316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:32.364047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 569/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:32.369977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:32.465308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54dea7-59d3-45fd-9462-203d9e1d9400 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:32.472932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:32.498964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436f82c-6b87-4554-b6e3-11801b990607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:32.499593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436f82c-6b87-4554-b6e3-11801b990607 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:32.499877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436f82c-6b87-4554-b6e3-11801b990607 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:32.500155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436f82c-6b87-4554-b6e3-11801b990607 None admin] PATH_INFO: `/v3/projects/a723ce9626974af5a5b4e41235fe1f3a` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:32.501846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436f82c-6b87-4554-b6e3-11801b990607 None admin] RBAC: Authorizing `identity:get_project(project_id=a723ce9626974af5a5b4e41235fe1f3a)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:32.503277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436f82c-6b87-4554-b6e3-11801b990607 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:32.504917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 576/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:32 2022] GET /identity/v3/projects/a723ce9626974af5a5b4e41235fe1f3a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:32.510885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:32.607513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff88f-c28b-4c6f-a075-e8ee12f32a55 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:32.639898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:32.640500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:32.640783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:32.641059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:32.642440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a723ce9626974af5a5b4e41235fe1f3a, user.id=37f3b15b06a6409483f92c49b1d39919) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:32.642749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:32.644161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63eeef-db5e-403c-b211-c696ff2bcbda None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:32.649365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 570/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:32 2022] GET /identity/v3/role_assignments?user.id=37f3b15b06a6409483f92c49b1d39919&scope.project.id=a723ce9626974af5a5b4e41235fe1f3a&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:31:34.654725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb91ab5-78c1-426a-9940-3a2c6654927a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:34.655252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb91ab5-78c1-426a-9940-3a2c6654927a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:34.655344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb91ab5-78c1-426a-9940-3a2c6654927a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:34.656628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 577/1147] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:34.661849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:34.662240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:34.662411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:34.680830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:34.682058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:34.693021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:34.747398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 571/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:34.769725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb91ab5-78c1-426a-9940-3a2c6654927a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:34.869120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb91ab5-78c1-426a-9940-3a2c6654927a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:34.900541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:34.901165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:34.901445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:34.901748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:34.911896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:34.916962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:34.918009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:34.918882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 578/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:34.924620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:35.020858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011947ed-ac4a-435f-9b47-d01501b7e414 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:35.054344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:35.054954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:35.055237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:35.055513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:35.056218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:35.056523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:35.057912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:35.067826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 572/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:35.073838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:35.108114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:35.171860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1d783-4dda-4ead-901f-1af4214be71e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:35.203426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:35.204567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:35.204846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:35.205119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] PATH_INFO: `/v3/users/37f3b15b06a6409483f92c49b1d39919` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:35.206276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] RBAC: Authorizing `identity:get_user(user_id=37f3b15b06a6409483f92c49b1d39919)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:35.207692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:35.209275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 579/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:35 2022] GET /identity/v3/users/37f3b15b06a6409483f92c49b1d39919 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:35.215217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:35.226925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:35.313040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239076bf-d683-4bda-8940-105a0a07e2c6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:35.345983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d500b2-d72d-488d-9cd2-76567f8284ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:35.346609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d500b2-d72d-488d-9cd2-76567f8284ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:35.346894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d500b2-d72d-488d-9cd2-76567f8284ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:35.347173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d500b2-d72d-488d-9cd2-76567f8284ab None admin] PATH_INFO: `/v3/projects/a723ce9626974af5a5b4e41235fe1f3a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:35.348320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d500b2-d72d-488d-9cd2-76567f8284ab None admin] RBAC: Authorizing `identity:get_project(project_id=a723ce9626974af5a5b4e41235fe1f3a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:35.349792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d500b2-d72d-488d-9cd2-76567f8284ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:35.351415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 573/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:35 2022] GET /identity/v3/projects/a723ce9626974af5a5b4e41235fe1f3a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:35.357233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:35.453085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912b07-541e-4ed4-885e-85ada4ee43ca None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:35.455074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:35.487367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b3a0b-4150-4593-90ac-7b57b0f2d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:35.488030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3a0b-4150-4593-90ac-7b57b0f2d5f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:35.488307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3a0b-4150-4593-90ac-7b57b0f2d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:35.488580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3a0b-4150-4593-90ac-7b57b0f2d5f6 None admin] PATH_INFO: `/v3/projects/a723ce9626974af5a5b4e41235fe1f3a/users/37f3b15b06a6409483f92c49b1d39919/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:35.490512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b3a0b-4150-4593-90ac-7b57b0f2d5f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a723ce9626974af5a5b4e41235fe1f3a, user_id=37f3b15b06a6409483f92c49b1d39919, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:35.491920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b3a0b-4150-4593-90ac-7b57b0f2d5f6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:35.503997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 580/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:31:35 2022] PUT /identity/v3/projects/a723ce9626974af5a5b4e41235fe1f3a/users/37f3b15b06a6409483f92c49b1d39919/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:31:37.455642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02c9f-8c9b-4752-9047-c6f439b709eb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:37.456238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02c9f-8c9b-4752-9047-c6f439b709eb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:37.456238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02c9f-8c9b-4752-9047-c6f439b709eb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:37.457526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 574/1154] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:37.462478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:37.462849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:37.463022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:37.480431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:37.481629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:37.544520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 581/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:37.567572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02c9f-8c9b-4752-9047-c6f439b709eb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:37.643400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:37.669798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02c9f-8c9b-4752-9047-c6f439b709eb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:37.703048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:37.703708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:37.703994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:37.704273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:37.714664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:37.719552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:37.720641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:37.721902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 575/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:37.726655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:37.820727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:37.830130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a804a1-3b1c-4f5c-9440-c70103fe28ab None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:37.863121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:37.863730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:37.864017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:37.864298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:37.865007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:37.865315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:37.866705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:37.874415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 582/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:37.880070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:37.977300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0eb0b-027a-45d3-ab0a-33dff959db93 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:38.009605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:38.010250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:38.010528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:38.010801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] PATH_INFO: `/v3/users/37f3b15b06a6409483f92c49b1d39919` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:38.011927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] RBAC: Authorizing `identity:get_user(user_id=37f3b15b06a6409483f92c49b1d39919)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:38.013347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:38.014928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 576/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:37 2022] GET /identity/v3/users/37f3b15b06a6409483f92c49b1d39919 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:38.020775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:38.119661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc18ca-5a88-4c20-afd4-42ce2e354b98 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:38.156125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:38.157389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:38.157701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:38.157982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:38.180993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:38.223674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:38.225118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:38.318294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 583/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 04:31:38.324177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:38.327962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:38.420909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136717b1-d167-4b6f-a367-4972137b6142 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:38.458094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf317bcf-ce88-422b-aa05-8f6a8f379d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:38.458829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf317bcf-ce88-422b-aa05-8f6a8f379d57 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:38.462431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf317bcf-ce88-422b-aa05-8f6a8f379d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:38.462731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf317bcf-ce88-422b-aa05-8f6a8f379d57 None admin] PATH_INFO: `/v3/projects/a723ce9626974af5a5b4e41235fe1f3a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:38.463944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf317bcf-ce88-422b-aa05-8f6a8f379d57 None admin] RBAC: Authorizing `identity:get_project(project_id=a723ce9626974af5a5b4e41235fe1f3a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:38.465383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf317bcf-ce88-422b-aa05-8f6a8f379d57 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:38.467080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 577/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:38 2022] GET /identity/v3/projects/a723ce9626974af5a5b4e41235fe1f3a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:38.474366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:38.527674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:38.570517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fb65f-4e44-422e-b1c2-d9e409ce11ca None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:38.602971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:38.603573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:38.603855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:38.604129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:38.604899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a723ce9626974af5a5b4e41235fe1f3a, user.id=37f3b15b06a6409483f92c49b1d39919) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:38.605207 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:38.606645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687b8e-bc7c-4476-b58d-0e74c5fb7cf1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:38.612252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 584/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:38 2022] GET /identity/v3/role_assignments?user.id=37f3b15b06a6409483f92c49b1d39919&scope.project.id=a723ce9626974af5a5b4e41235fe1f3a&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:40.581507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34b997-90cb-4b9e-ab8b-accf15dfc4bc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:40.582061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34b997-90cb-4b9e-ab8b-accf15dfc4bc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:40.582151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34b997-90cb-4b9e-ab8b-accf15dfc4bc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:40.583430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 578/1162] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:40.588673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:40.589094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:40.589217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:40.606749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:40.607916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:40.670561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 585/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:40.692527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34b997-90cb-4b9e-ab8b-accf15dfc4bc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:40.761152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:40.792315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34b997-90cb-4b9e-ab8b-accf15dfc4bc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:40.824378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:40.824976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:40.825299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:40.825538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:40.895266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:40.896647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:40.963397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:40.992468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 579/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:40.998589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:41.045266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:41.093843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6273-944a-4ca4-9c14-f2e92d69f801 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:41.126867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:41.127485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:41.127765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:41.128037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:41.134429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:41.135854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-737404c0-8cbb-441e-a640-ab4f383577d1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:41.147609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:41.148652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:41.149801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 586/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:31:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:41.154658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:41.251796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094fec1-667e-4157-b43d-6d3220862152 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:41.284187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:41.284787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:41.285072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:41.285348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:41.286056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:41.286360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:41.287720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4536-572d-4515-8e8b-0d24fb5d2dfe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:41.294885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 580/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 29 04:31:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:43.229299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395906eb-6ad4-437a-9ee6-351f93201db4 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:43.229827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395906eb-6ad4-437a-9ee6-351f93201db4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:43.229827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395906eb-6ad4-437a-9ee6-351f93201db4 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:43.231135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 587/1167] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:43.237153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2a79-ed40-42ea-b389-c56d486ac8ae None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:43.237526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2a79-ed40-42ea-b389-c56d486ac8ae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:43.237762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2a79-ed40-42ea-b389-c56d486ac8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:43.255423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b0ab2a79-ed40-42ea-b389-c56d486ac8ae None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:43.256614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b0ab2a79-ed40-42ea-b389-c56d486ac8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:43.284713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:43.322196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 581/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:43.344555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395906eb-6ad4-437a-9ee6-351f93201db4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:43.442010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395906eb-6ad4-437a-9ee6-351f93201db4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:43.450806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:43.475429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1c2a-4335-4c6f-8144-33fcc5d58b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:43.476032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1c2a-4335-4c6f-8144-33fcc5d58b07 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:43.476320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1c2a-4335-4c6f-8144-33fcc5d58b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:43.476601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1c2a-4335-4c6f-8144-33fcc5d58b07 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:43.477312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb1c2a-4335-4c6f-8144-33fcc5d58b07 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:43.478705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb1c2a-4335-4c6f-8144-33fcc5d58b07 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:43.494123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 588/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Fri Jul 29 04:31:43 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:45.509959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf2da-9fe9-4620-8690-d1974726330d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:45.510604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf2da-9fe9-4620-8690-d1974726330d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:45.510604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf2da-9fe9-4620-8690-d1974726330d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:45.511896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 582/1170] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:45.516894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:45.517333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:45.517435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:45.535490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:45.536678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:45.601181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 589/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:45.624067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bf2da-9fe9-4620-8690-d1974726330d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:45.721868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bf2da-9fe9-4620-8690-d1974726330d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:45.754352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c625eb0-f68e-47ea-b24e-d799a4bcfd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:45.754982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625eb0-f68e-47ea-b24e-d799a4bcfd58 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:45.755261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625eb0-f68e-47ea-b24e-d799a4bcfd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:45.755531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625eb0-f68e-47ea-b24e-d799a4bcfd58 None admin] PATH_INFO: `/v3/domains/e3f1b9afc0e14ab2b8362ea89998c7f6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:45.766177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625eb0-f68e-47ea-b24e-d799a4bcfd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e3f1b9afc0e14ab2b8362ea89998c7f6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:45.767551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625eb0-f68e-47ea-b24e-d799a4bcfd58 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:45.769133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 583/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Fri Jul 29 04:31:45 2022] GET /identity/v3/domains/e3f1b9afc0e14ab2b8362ea89998c7f6 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:45.774995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:45.866773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:45.870831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d12f-bea8-415d-866b-05425403de0c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:45.903755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362f45-f9e2-411a-afe2-fc74a0f518b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:45.904353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362f45-f9e2-411a-afe2-fc74a0f518b2 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:45.904632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362f45-f9e2-411a-afe2-fc74a0f518b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:45.904900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362f45-f9e2-411a-afe2-fc74a0f518b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:45.905564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d362f45-f9e2-411a-afe2-fc74a0f518b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:45.907561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d362f45-f9e2-411a-afe2-fc74a0f518b2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:45.932449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 590/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:31:45 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:47.965261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3af2-3082-4870-90c2-a373914792ec None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:47.965746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3af2-3082-4870-90c2-a373914792ec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:47.965844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3af2-3082-4870-90c2-a373914792ec None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:47.967166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 584/1174] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:47.972807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:47.973182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:47.973380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:47.991080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:47.992267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:48.056572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 591/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:48.081145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3af2-3082-4870-90c2-a373914792ec None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:48.108562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:48.180745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3af2-3082-4870-90c2-a373914792ec None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:48.212598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70cf44-7d0d-4ffa-8175-7c4a1dca2cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:48.213163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70cf44-7d0d-4ffa-8175-7c4a1dca2cfa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:48.213444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70cf44-7d0d-4ffa-8175-7c4a1dca2cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:48.213749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70cf44-7d0d-4ffa-8175-7c4a1dca2cfa None admin] PATH_INFO: `/v3/domains/e3f1b9afc0e14ab2b8362ea89998c7f6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:48.214873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70cf44-7d0d-4ffa-8175-7c4a1dca2cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=e3f1b9afc0e14ab2b8362ea89998c7f6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:48.216289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70cf44-7d0d-4ffa-8175-7c4a1dca2cfa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:48.217882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 585/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Fri Jul 29 04:31:48 2022] GET /identity/v3/domains/e3f1b9afc0e14ab2b8362ea89998c7f6 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:48.224262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:48.300667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:48.320417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2235a-881c-4bd1-9ab1-230b5e2af49c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:48.352418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bc33b-6f7f-435a-8c75-510f27a603fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:48.353022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc33b-6f7f-435a-8c75-510f27a603fc None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:48.353302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc33b-6f7f-435a-8c75-510f27a603fc None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:48.353576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bc33b-6f7f-435a-8c75-510f27a603fc None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:48.354267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bc33b-6f7f-435a-8c75-510f27a603fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:48.355676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bc33b-6f7f-435a-8c75-510f27a603fc None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:48.375422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 592/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:31:48 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:31:50.385417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea7b42-dfb7-46ba-b9b5-a61b093b82cc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:50.385994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea7b42-dfb7-46ba-b9b5-a61b093b82cc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:50.385994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea7b42-dfb7-46ba-b9b5-a61b093b82cc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:50.387320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 586/1178] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:50.392992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:50.393421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:50.393551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:50.412446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:50.413632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:50.476833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 593/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:50.501305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea7b42-dfb7-46ba-b9b5-a61b093b82cc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:50.592095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:50.600154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea7b42-dfb7-46ba-b9b5-a61b093b82cc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:50.632249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:50.632869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:50.633148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:50.633418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:50.643536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:50.648295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:50.649574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:50.650689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 587/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:50.655450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:50.717295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:50.751372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53918f23-e205-41b2-9271-a7269df247b7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:50.783220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:50.783817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:50.784099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:50.784371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:50.785067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:50.785370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:50.786743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:50.794706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 594/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:50.800781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:50.897490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7240310-b8c5-4a84-85dc-d508e3858791 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:50.930682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:50.931314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:50.931592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:50.931866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] PATH_INFO: `/v3/users/4357fc1f3ac94bc79977b519b576050b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:50.944641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] RBAC: Authorizing `identity:get_user(user_id=4357fc1f3ac94bc79977b519b576050b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:50.946105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:50.947702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 588/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:50 2022] GET /identity/v3/users/4357fc1f3ac94bc79977b519b576050b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:50.954104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:51.050238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a079aa-ff4f-4145-97da-0d7e8166994c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:51.074855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:51.083396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:51.084001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:51.084283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:51.084560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:51.149213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:51.150601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:51.244381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 595/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:51.250848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:51.269382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:51.351256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae161f-1029-493e-9768-10f82c2423b3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:51.383816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79c024-6eec-4e54-b249-108fab9b360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:51.384438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c024-6eec-4e54-b249-108fab9b360f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:51.384723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c024-6eec-4e54-b249-108fab9b360f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:51.384999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c024-6eec-4e54-b249-108fab9b360f None admin] PATH_INFO: `/v3/projects/625c5f91f5b6443581c79c3411277e2f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:51.386169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c024-6eec-4e54-b249-108fab9b360f None admin] RBAC: Authorizing `identity:get_project(project_id=625c5f91f5b6443581c79c3411277e2f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:51.387595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c024-6eec-4e54-b249-108fab9b360f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:51.389221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 589/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:51 2022] GET /identity/v3/projects/625c5f91f5b6443581c79c3411277e2f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:51.395870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:51.422631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:51.491935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc2e68-285e-4987-84be-824491e28c79 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:51.524514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:51.525117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:51.525399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:51.525700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:51.526470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=625c5f91f5b6443581c79c3411277e2f, user.id=4357fc1f3ac94bc79977b519b576050b) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:51.526779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:51.528190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2d01b-6e52-4f57-8b1f-13dcbc73954a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:51.533332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 596/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:51 2022] GET /identity/v3/role_assignments?user.id=4357fc1f3ac94bc79977b519b576050b&scope.project.id=625c5f91f5b6443581c79c3411277e2f&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:53.479201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9016f2-8475-4f8f-ad96-7d444046f1c2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:53.479726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9016f2-8475-4f8f-ad96-7d444046f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:53.479853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9016f2-8475-4f8f-ad96-7d444046f1c2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:53.481121 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 590/1186] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:53.486908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:53.487322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:53.487471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:53.507182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:53.509151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:53.578915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 597/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:53.601954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9016f2-8475-4f8f-ad96-7d444046f1c2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:53.681361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:53.703125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9016f2-8475-4f8f-ad96-7d444046f1c2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:53.736390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:53.737021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:53.737303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:53.737578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:53.747313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:53.752224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:53.753305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:31:53.754423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 591/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:53.759346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:53.782456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:53.858473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4917e2-9e4f-461a-aa44-1930d6c5640f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:53.896543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:53.897161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:53.897443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:53.897749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:53.898461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:53.898766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:53.900144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:53.908497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 598/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:53.914443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:54.012507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6df23-7a61-472a-8ea9-3ea9013e44ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:54.047044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:54.047665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:54.047949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:54.048227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] PATH_INFO: `/v3/users/4357fc1f3ac94bc79977b519b576050b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:54.049376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] RBAC: Authorizing `identity:get_user(user_id=4357fc1f3ac94bc79977b519b576050b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:54.050843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:54.052415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 592/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:53 2022] GET /identity/v3/users/4357fc1f3ac94bc79977b519b576050b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:54.058176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:54.137831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:54.153771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ad79a-5b99-4056-ab8c-02a0e8846de8 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:54.188676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8f66-0e8d-444f-aee6-f94d0ea8b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:54.189320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8f66-0e8d-444f-aee6-f94d0ea8b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:54.189626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8f66-0e8d-444f-aee6-f94d0ea8b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:54.189914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8f66-0e8d-444f-aee6-f94d0ea8b7c3 None admin] PATH_INFO: `/v3/projects/625c5f91f5b6443581c79c3411277e2f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:54.191070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af8f66-0e8d-444f-aee6-f94d0ea8b7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=625c5f91f5b6443581c79c3411277e2f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:54.192513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af8f66-0e8d-444f-aee6-f94d0ea8b7c3 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:54.194215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 599/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:54 2022] GET /identity/v3/projects/625c5f91f5b6443581c79c3411277e2f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:54.200164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:54.210759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:54.297413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a507c-5a7a-4dcf-9b26-a2172aa0e5ef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:54.329466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1b62e-2b3f-4c76-8341-798616bbc556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:54.330144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b62e-2b3f-4c76-8341-798616bbc556 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:54.330428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b62e-2b3f-4c76-8341-798616bbc556 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:54.330702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b62e-2b3f-4c76-8341-798616bbc556 None admin] PATH_INFO: `/v3/projects/625c5f91f5b6443581c79c3411277e2f/users/4357fc1f3ac94bc79977b519b576050b/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:54.332626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1b62e-2b3f-4c76-8341-798616bbc556 None admin] RBAC: Authorizing `identity:create_grant(project_id=625c5f91f5b6443581c79c3411277e2f, user_id=4357fc1f3ac94bc79977b519b576050b, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:54.334101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1b62e-2b3f-4c76-8341-798616bbc556 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:54.346513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 593/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:31:54 2022] PUT /identity/v3/projects/625c5f91f5b6443581c79c3411277e2f/users/4357fc1f3ac94bc79977b519b576050b/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:31:56.287024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0923-5039-4465-8970-0b865e11b818 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:56.287550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0923-5039-4465-8970-0b865e11b818 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:56.287640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0923-5039-4465-8970-0b865e11b818 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:56.288935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 600/1193] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:31:56.294193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:56.294610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:56.294744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:56.313263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:31:56.314464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:31:56.373244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:56.380162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 594/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:31:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:31:56.402280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0923-5039-4465-8970-0b865e11b818 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:56.501197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0923-5039-4465-8970-0b865e11b818 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:56.533115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:56.533762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:56.534042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:56.534313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:56.544696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:31:56.550160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:31:56.551254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:31:56.552151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 601/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:31:56.557246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:56.650336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5909-0b43-4c09-8283-65479f43fe9c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:56.682884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:56.683485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:56.683765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:56.684038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:56.684733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:56.685034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:56.686434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:56.694598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 595/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:31:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:56.700226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:56.715420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:56.798157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74876d-a5b1-4795-9f92-97d62938e012 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:56.829995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:56.830625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:56.830906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:56.831183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] PATH_INFO: `/v3/users/4357fc1f3ac94bc79977b519b576050b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:56.832332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] RBAC: Authorizing `identity:get_user(user_id=4357fc1f3ac94bc79977b519b576050b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:56.833772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:56.835340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 602/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 29 04:31:56 2022] GET /identity/v3/users/4357fc1f3ac94bc79977b519b576050b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:56.841019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:56.902103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:56.942854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b6607-9564-497c-820f-3d1dd4e672bf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:56.976764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:56.977375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:56.977697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:56.977979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:57.042305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:57.043735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:57.098283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:57.137185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 596/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:31:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:31:57.143702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:57.221567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:31:57.239619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723fda4-ead9-48ca-99fa-b4efafdc1b04 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:57.271700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c4aa-d819-42c6-aa7f-8039fb909369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:57.272341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c4aa-d819-42c6-aa7f-8039fb909369 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:57.272662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c4aa-d819-42c6-aa7f-8039fb909369 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:57.273000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c4aa-d819-42c6-aa7f-8039fb909369 None admin] PATH_INFO: `/v3/projects/625c5f91f5b6443581c79c3411277e2f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:57.274314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609c4aa-d819-42c6-aa7f-8039fb909369 None admin] RBAC: Authorizing `identity:get_project(project_id=625c5f91f5b6443581c79c3411277e2f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:57.276039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609c4aa-d819-42c6-aa7f-8039fb909369 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:57.277829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 603/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 29 04:31:57 2022] GET /identity/v3/projects/625c5f91f5b6443581c79c3411277e2f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:31:57.284363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:31:57.382438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3192363-02d4-4930-ba27-8b4c5f202027 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:31:57.414954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:31:57.415556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:31:57.416094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:31:57.416370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:31:57.417144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=625c5f91f5b6443581c79c3411277e2f, user.id=4357fc1f3ac94bc79977b519b576050b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:31:57.417455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:31:57.418904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206d54-15f0-4e4a-a60d-0289d8e6736e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:31:57.424547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 597/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:31:57 2022] GET /identity/v3/role_assignments?user.id=4357fc1f3ac94bc79977b519b576050b&scope.project.id=625c5f91f5b6443581c79c3411277e2f&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:32:07.267651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=26 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:07.422052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:51.978793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406934c-0e61-4550-ac77-6a9046f3aec6 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:51.979531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406934c-0e61-4550-ac77-6a9046f3aec6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:51.979531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406934c-0e61-4550-ac77-6a9046f3aec6 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:51.980994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 604/1201] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:32:51.986513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:51.987023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:51.987116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:52.008357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:32:52.011804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:32:52.115058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 598/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:32:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:32:52.142889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406934c-0e61-4550-ac77-6a9046f3aec6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:52.303169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406934c-0e61-4550-ac77-6a9046f3aec6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:52.355868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:52.357413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:52.357804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:52.358129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:52.386351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:52.389669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:32:52.416077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:32:52.417204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:32:52.418686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:32:52.418686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:32:52.418686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:32:52.418686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:32:52.418686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 605/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:32:52.427112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:52.556964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e132-de5f-439c-96c6-3c1be8961f77 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:52.593845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:52.607199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:52.607878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:52.608143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:52.608399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:52.609092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:52.609401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:52.610824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c7891-5464-4479-b27f-6061d4337118 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:52.623319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 599/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:32:52.629520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:52.697811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:52.762595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35218-0ca6-43a6-b9c4-a3be8f481f9d None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:52.811239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09a7d9-f0d4-41ae-b475-66617042cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:52.811907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a7d9-f0d4-41ae-b475-66617042cad4 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:52.812201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a7d9-f0d4-41ae-b475-66617042cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:52.812489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a7d9-f0d4-41ae-b475-66617042cad4 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:52.815826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09a7d9-f0d4-41ae-b475-66617042cad4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:52.815826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09a7d9-f0d4-41ae-b475-66617042cad4 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:52.849842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 606/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 29 04:32:52 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:32:55.104725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d40b-01c3-48fa-bd91-331e3b9298d7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:55.105266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d40b-01c3-48fa-bd91-331e3b9298d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:55.105519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d40b-01c3-48fa-bd91-331e3b9298d7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:55.107249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 600/1206] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:32:55.112937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:55.113447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:55.113690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:55.133158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:32:55.134686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:32:55.216645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 607/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:32:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:32:55.240466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d40b-01c3-48fa-bd91-331e3b9298d7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:55.362521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d40b-01c3-48fa-bd91-331e3b9298d7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:55.406154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:55.406948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:55.407232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:55.407509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:55.420137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:32:55.426296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:32:55.427470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:32:55.428671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 601/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:32:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:32:55.435078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:55.486792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:55.553319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fec3d-7f90-4550-8751-06a3f47df343 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:55.589582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:55.590226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:55.591029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:55.591305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:55.592018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:55.592322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:55.593732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:55.602004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 608/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:32:55.610486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:55.673063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:55.729903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6e9e-a514-495f-86b6-63cd862f2271 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:55.774962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:55.775649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:55.775948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:55.776228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:55.788724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:55.790522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:32:55.805617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:32:55.810441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:32:55.811549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:32:55.811549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:32:55.811549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:32:55.811549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:32:55.811549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 602/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:32:55.815065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:55.924079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:55.929240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7178e-caec-4859-a1cb-1d038f5d34f6 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:55.970934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:55.971599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:55.971898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:55.972169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:55.973143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:55.973566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:55.975224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:55.990362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 609/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:32:55.997189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:56.128012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606946c-bd35-4da6-ae10-ef7962a2d07a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:56.129894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:56.179862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:56.180524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:56.180800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:56.181077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:56.191365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:56.193063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:32:56.213502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:32:56.214983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:32:56.216538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 603/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:32:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:32:56.221863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:56.347272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6c7a-1f79-4c07-abf2-21de89eb1158 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:56.390569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:56.391315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:56.391660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:56.392019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:56.392931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:56.393302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:56.394917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:56.419092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 610/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 29 04:32:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:32:56.424136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:56.547353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84155bb7-b0fd-4e3b-8f46-729d361ff2b9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:56.590106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:56.591128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:56.591264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:56.591470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:56.625900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:56.674082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:56.676003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:56.790743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 604/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:32:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:32:56.797464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:56.824607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:56.921424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99023-ba27-4055-bfc3-608254205c40 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:56.959891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:56.960632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:56.960923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:56.961200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:56.974247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:56.975782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:32:56.992635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:32:56.993688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:32:56.994635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:32:56.994635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:32:56.994635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:32:56.994635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:32:56.994635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 611/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:32:57.000796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:57.068879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:57.113003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0a645-d207-4be7-8968-ab6d145eb773 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:57.153736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:57.154407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:57.154710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:57.154995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:57.155809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:57.156123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:57.157803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:57.170844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 605/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:32:57.176608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:57.255600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:57.291834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1dce-2cd8-4d6d-8872-992892e5ba56 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:57.328259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:57.328970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:57.329307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:57.329623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:57.337588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:57.339072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:32:57.350909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:32:57.351801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:32:57.358276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 612/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:32:57.358785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:57.474278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbdf9-0805-494a-b1a6-78ed9b80e231 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:57.499181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:57.515030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:57.515697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:57.516041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:57.516417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:57.517372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:57.517822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:57.519693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cb700-ba5f-4eb1-90d0-c92671a80048 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:57.544120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 606/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:32:57.545928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:32:57.671616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e0ca5-2ef6-4bde-ac4b-3ff2168b42e0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:32:57.704780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:32:57.711511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:32:57.712249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:57.712675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:57.713080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:57.714007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=69d05210f0894bec881969d3ae3ad4f4) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:32:57.714425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:32:57.716579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dbae8-5aaa-4b3f-a991-e0d4275353ec None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:32:57.723417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 613/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:32:57 2022] GET /identity/v3/role_assignments?user.id=69d05210f0894bec881969d3ae3ad4f4&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:32:59.866065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062561e-43a8-4ac4-a1ec-48a79d404e8a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:59.866599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062561e-43a8-4ac4-a1ec-48a79d404e8a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:59.866599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062561e-43a8-4ac4-a1ec-48a79d404e8a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:59.867956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 607/1220] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:32:59.873821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:32:59.874255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:32:59.874437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:32:59.895533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:32:59.897103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:32:59.972557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 614/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:32:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:32:59.997914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062561e-43a8-4ac4-a1ec-48a79d404e8a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:00.117422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062561e-43a8-4ac4-a1ec-48a79d404e8a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:00.152107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:00.153294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:00.153577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:00.153878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:00.164175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:33:00.169959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:00.171235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:00.172530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 608/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:00.177556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:00.283440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7109776-98d9-4bb6-b978-7e6e5b7848aa None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:00.308272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:00.319726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:00.320342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:00.320633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:00.321002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:00.321960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] RBAC: Adding query filter params (name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:00.322268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:00.323967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:00.333679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 615/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:33:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:00.339822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:00.391604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:00.453624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedbb74-6311-49a4-9f6a-3e4f322f4767 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:00.491431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:00.492070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:00.492349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:00.492624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:00.502507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:00.503946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:00.519366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:00.520331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:00.521207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:00.521207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:00.521207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:00.521207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:00.521207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 609/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:00.526462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:00.636413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05b4b-c8f2-4f5c-bb7c-66630c4e9475 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:00.677506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:00.678137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:00.678446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:00.678788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:00.679708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:00.680051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:00.681725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:00.697112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 616/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:00.703511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:00.808391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:00.816680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c2e3-799c-46fa-bc90-7f77c221969f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:00.854828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:00.855453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:00.855733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:00.856005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:00.863920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:00.865585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:33:00.878688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:00.880495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:00.881742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 610/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:33:00.885624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:00.943166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:01.004388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bffdf-4017-45ff-9c42-d66a7a2f5d3a None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:01.050748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:01.051517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:01.051886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:01.052219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:01.053026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:01.053332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:01.054784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:01.073587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 617/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 29 04:33:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:01.080276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:01.206005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7adb3-1eca-4cb3-b2f3-069aa42bd9c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:01.251839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:01.252752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:01.253180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:01.253633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:01.266604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:01.268021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:01.288461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:01.290515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:01.292027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:01.292027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:01.292027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:01.292027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:01.292027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 611/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:01.295786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:01.400748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a02f-a055-48b2-b9ec-9fcef0915c01 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:01.403656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:01.437572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:01.438223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:01.438508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:01.438795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:01.439465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:01.439765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:01.441140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:01.455423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 618/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:01.461417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:01.472880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:01.576717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e999b-4454-48cf-a35c-4c3b679cb622 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:01.616241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:01.616961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:01.617249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:01.617527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:01.625892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:01.627347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:33:01.640323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:01.641399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:01.647252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 612/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:01.648048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:01.776811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94708a53-1bce-4624-a448-f1dba5cae139 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:01.812120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:01.812735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:01.813015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:01.813288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:01.814058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:01.814361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:01.815774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4147ab6-025b-4bdc-bb23-d07119672a51 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:01.828161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 619/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:01.834142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:01.901085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:01.940895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f93c-eca4-4471-a096-729c18ab32d4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:01.977654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189976f-0805-4ecc-8aed-22787d507900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:01.978606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189976f-0805-4ecc-8aed-22787d507900 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:01.978997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189976f-0805-4ecc-8aed-22787d507900 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:01.979348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189976f-0805-4ecc-8aed-22787d507900 None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/69d05210f0894bec881969d3ae3ad4f4/roles/51a2cd9038c2429b9de55385d007b315` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:01.997427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189976f-0805-4ecc-8aed-22787d507900 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=69d05210f0894bec881969d3ae3ad4f4, role_id=51a2cd9038c2429b9de55385d007b315)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:01.999126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189976f-0805-4ecc-8aed-22787d507900 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:02.015161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 613/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:33:01 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/69d05210f0894bec881969d3ae3ad4f4/roles/51a2cd9038c2429b9de55385d007b315 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:33:04.222530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221635-cb70-480f-a458-2d8911f2cebe None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:04.223057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221635-cb70-480f-a458-2d8911f2cebe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:04.223057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221635-cb70-480f-a458-2d8911f2cebe None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:04.224330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 620/1233] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:04.229469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:04.229928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:04.230067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:04.248103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:04.249312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:04.319568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 614/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:04.345981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c221635-cb70-480f-a458-2d8911f2cebe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:04.371719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:04.454426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c221635-cb70-480f-a458-2d8911f2cebe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:04.490522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:04.491164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:04.491443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:04.491707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:04.503698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:33:04.509288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:04.510476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:04.511492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 621/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 29 04:33:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:04.517499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:04.566698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:04.631416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c71513-f3d9-410a-aeef-2be6d657864f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:04.671374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:04.672023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:04.672298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:04.672575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:04.673284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:04.673586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:04.675096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:04.683809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 615/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 29 04:33:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:04.690348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:04.779304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:04.796066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab899308-05bc-42ed-a870-730ecf78892c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:04.831155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:04.831794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:04.832079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:04.832355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:04.842891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:04.844330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:04.858790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:04.859862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:04.865655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:04.865655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:04.865655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:04.865655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:04.865655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 622/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:04.865998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:04.974855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4f954-abc9-4b5b-afd6-55457ce09be5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:04.985640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:05.013203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:05.013865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:05.014166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:05.014408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:05.015106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:05.015387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:05.016747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:05.028718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 616/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:05.035088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:05.144901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c172-20d4-4d22-ae4f-0d0525a6b40b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:05.182865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:05.183502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:05.184318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:05.184645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:05.187435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:05.192864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:05.194477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:33:05.206351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:05.207407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:05.208335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 623/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:05.213328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:05.317522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c9b7-5a7e-4d6b-bc41-3f1bcc191e7c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:05.353373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:05.354019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:05.354298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:05.354569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:05.355356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:05.355693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:05.357117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:05.375687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 617/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 29 04:33:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:33:05.381252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:05.491328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f648-d8e4-4677-b1c3-20521759c78e None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:05.536618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:05.537270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:05.537552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:05.537853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:05.608993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:05.615850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:05.617421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:05.737923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 624/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:33:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:33:05.743781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:05.771133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:05.848606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341ad0-db90-439c-b0f9-e3e9243db426 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:05.888058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:05.888693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:05.888978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:05.889249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:05.900642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:05.902185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:05.921639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:05.922666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:05.923542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:05.923542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:05.923542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:05.923542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:05.923542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 618/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:05.930593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:06.037921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:06.046597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80034308-e7cc-4fd0-95ea-f17a7b9d409b None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:06.085665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:06.086564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:06.086855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:06.087242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:06.088680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:06.089173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:06.093400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:06.106805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 625/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:06.112552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:06.197772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:06.222439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98fe8-3000-4da0-8448-b3d105f730cf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:06.260684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:06.261346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:06.261671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:06.261961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:06.268887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:06.270435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:33:06.282857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:06.283759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:06.284634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:06.289264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 619/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:06.290473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:06.396511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe3a9-4273-413e-8121-ef8fbac05582 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:06.432293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:06.432909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:06.433193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:06.433469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:06.434285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:06.434594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:06.436008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8339-5711-4c95-8240-54d6b1af2726 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:06.447722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 626/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:06.454453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:06.560791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1652599-6f3c-4576-b572-52204c1f1610 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:06.598499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:06.599110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:06.599400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:06.599674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:06.600454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] RBAC: Adding query filter params (role.id=51a2cd9038c2429b9de55385d007b315, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=69d05210f0894bec881969d3ae3ad4f4) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:06.600764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:06.602307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59da46-d817-447b-8dc7-fa80dc9b9a9a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:06.608513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 620/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:33:06 2022] GET /identity/v3/role_assignments?user.id=69d05210f0894bec881969d3ae3ad4f4&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=51a2cd9038c2429b9de55385d007b315 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:08.780659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30de7-e8b0-42db-95c9-7bb020ea1724 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:08.781231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30de7-e8b0-42db-95c9-7bb020ea1724 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:08.781231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d30de7-e8b0-42db-95c9-7bb020ea1724 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:08.782598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 627/1247] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:08.787985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:08.788520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:08.788520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:08.795182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:08.807957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:08.809201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:08.879245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 621/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:08.903383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d30de7-e8b0-42db-95c9-7bb020ea1724 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:08.923115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:09.020517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d30de7-e8b0-42db-95c9-7bb020ea1724 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:09.062526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:09.063294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:09.063593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:09.063975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:09.075517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:33:09.081840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:09.082932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:09.083779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 628/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 29 04:33:09.089423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:09.200267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33fa5-f00d-4272-8f9b-eb15ec6862df None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:09.230396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:09.236370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:09.236984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:09.237264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:09.237536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:09.238268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:09.238571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:09.240253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:09.248854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 622/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:09.255152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:09.362780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:09.390457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b35870-1cfb-4ddf-ad3f-3b82240ffab1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:09.429964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:09.430593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:09.430916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:09.431283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:09.441919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:09.443473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:09.462099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:09.463227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:09.464154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:09.464154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:09.464154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:09.464154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:09.464154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 629/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:09.469630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:09.577702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad5940-423d-4099-8d53-deff25a4d200 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:09.614156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:09.614815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:09.615060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:09.615334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:09.616016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:09.616314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:09.617712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:09.631023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 623/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:09.636804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:09.757993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3557e6-6014-48a7-b459-cf5f983ea501 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:09.785323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:09.794197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:09.794846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:09.795119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:09.795389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:09.804713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:09.806648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:33:09.819453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:09.820559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:09.821523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 630/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:09.826834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:09.890187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:09.941225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baa034-aa05-4381-8e13-7eb90736059d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:09.975942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:09.976558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:09.976838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:09.977110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:09.977928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:09.978235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:09.979658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:09.997460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 624/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 29 04:33:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:10.003469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:10.110606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4009-ef4e-4803-868a-83be7645d2e0 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:10.150144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:10.150608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:10.150899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:10.151178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:10.210357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:10.226679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:10.228415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:10.338051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 631/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:33:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 29 04:33:10.343987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:10.459979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648a197-06ce-412a-acdd-b49c2e265828 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:10.476033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:10.500205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:10.500847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:10.501132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:10.501411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:10.512870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:10.514693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:10.531561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:10.532544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:10.533429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:10.533429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:10.533429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:10.533429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:10.533429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 625/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:10.538998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:10.639449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:10.653879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01ff55-afa3-40f4-a48e-45c02b34baf5 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:10.698283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:10.698916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:10.699776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:10.700074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:10.700818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:10.701075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:10.702636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:10.715554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 632/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:10.721176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:10.836137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2549626-f9c8-47f4-b012-c67cf67b9c42 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:10.871607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:10.872238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:10.872522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:10.872799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:10.880008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:10.882088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:33:10.895704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:10.897060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:10.898306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 626/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:10.903096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:11.006066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669fee-c0f7-4668-b141-2ceecd331e99 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:11.040360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:11.040998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:11.041281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:11.041552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:11.042317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:11.042622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:11.044581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ff58-128a-4d6a-a285-fa61ce8a6d97 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:11.056651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 633/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:11.063425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:11.091161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:11.169029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171f32-d6c0-4184-a0ff-97849ce6c558 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:11.205588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:11.206226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:11.206513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:11.206798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:11.207567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=69d05210f0894bec881969d3ae3ad4f4) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:11.207879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:11.209335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc395a-5022-46a7-948c-2daaa70722fd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:11.214989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 627/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:33:11 2022] GET /identity/v3/role_assignments?user.id=69d05210f0894bec881969d3ae3ad4f4&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:33:13.177936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176197bc-b7ca-4b1f-aa66-be0d735da84e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:13.178458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176197bc-b7ca-4b1f-aa66-be0d735da84e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:13.178582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176197bc-b7ca-4b1f-aa66-be0d735da84e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:13.179838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 634/1261] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:13.185398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:13.185802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:13.185925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:13.203380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:13.204546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:13.267700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 628/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 29 04:33:13.289168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176197bc-b7ca-4b1f-aa66-be0d735da84e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:13.300408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:13.387218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176197bc-b7ca-4b1f-aa66-be0d735da84e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:13.419341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:13.419954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:13.420233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:13.420506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:13.430093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:33:13.435014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:13.436103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:13.437153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 635/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:13.441889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:13.459628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:13.537998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59516-6fa4-4e26-8ebc-d43fb4c6c93f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:13.572073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:13.572675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:13.572955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:13.573228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:13.574541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:13.574847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:13.576200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:13.583926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 629/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:13.589726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:13.654626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:13.695161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f370ded-76c7-4b3a-8649-60d0a089fc38 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:13.732171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:13.733070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:13.733472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:13.733858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:13.745631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:13.747561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:13.762382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:13.763388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:13.764444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:13.764444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:13.764444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:13.764444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:13.764444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 636/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:13.769514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:13.848088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:13.867661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4f23-1b38-428e-b44a-439d21d2d397 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:13.899784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:13.900384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:13.900664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:13.900937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:13.901632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:13.901958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:13.903318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:13.914658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 630/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:13.920842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.017069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d9cda-15e9-4bb6-b3c2-42fe20c9cf15 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:14.036232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:14.050318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:14.050953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:14.051237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:14.051514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:14.059579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:14.061021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:33:14.071913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:14.072977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:14.074886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 637/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:14.079308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.177278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47fa2-eb6c-4503-b2c9-449d3c868f17 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:14.210330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:14.210935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:14.211217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:14.211491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:14.212299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:14.212603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:14.214068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:14.222405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:14.230924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 631/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 29 04:33:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:14.236529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.332630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20ab0d-2dd5-43ca-9e50-1f7f2dd168a1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:14.364126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:14.364745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:14.365027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:14.365308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:14.375927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:14.377363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:14.391572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:14.392665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:14.393583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:14.393583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:14.393583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:14.393583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:14.393583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 638/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:14.398204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.497314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc82a89-0c1c-4751-9a1c-a40a99045b4e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:14.534399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:14.535011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:14.535294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:14.535569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:14.536242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:14.536545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:14.538021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:14.549314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 632/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:14.554969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.586559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:14.652590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258713c-4b01-4d27-82c3-ccda8664b0ae None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:14.697037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:14.697708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:14.697970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:14.698238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:14.705417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:14.706838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:33:14.718091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:14.719156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:14.720240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 639/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:14.725195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.783381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:14.824951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b756af-44a9-4871-bb10-4fcced8df35a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:14.857274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:14.857846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:14.858133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:14.858409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:14.859147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:14.859454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:14.860876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8750ad-f036-454a-aa10-6643098cab2b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:14.872442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 633/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:14.878487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:14.967542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:14.976902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69250ef-5a0f-42a6-9139-238d034de568 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:15.009436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fb710-d149-4c4b-8110-0fb408f3e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:15.010127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb710-d149-4c4b-8110-0fb408f3e89a None admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:15.010411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb710-d149-4c4b-8110-0fb408f3e89a None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:15.010687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb710-d149-4c4b-8110-0fb408f3e89a None admin] PATH_INFO: `/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/69d05210f0894bec881969d3ae3ad4f4/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:15.013244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fb710-d149-4c4b-8110-0fb408f3e89a None admin] RBAC: Authorizing `identity:create_grant(project_id=a55e2cd3f5e44abcbb6c908a7d8552fd, user_id=69d05210f0894bec881969d3ae3ad4f4, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:15.014696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fb710-d149-4c4b-8110-0fb408f3e89a None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:15.026866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 640/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 29 04:33:14 2022] PUT /identity/v3/projects/a55e2cd3f5e44abcbb6c908a7d8552fd/users/69d05210f0894bec881969d3ae3ad4f4/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:33:16.954676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a5f3-01cf-4258-a308-884bcc968c7a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:16.955110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a5f3-01cf-4258-a308-884bcc968c7a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:16.955232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a5f3-01cf-4258-a308-884bcc968c7a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:16.956585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 634/1274] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:16.961496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:16.961877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:16.962086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:16.980149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:16.981318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:17.043811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 641/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:17.072163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a5f3-01cf-4258-a308-884bcc968c7a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:17.175272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a5f3-01cf-4258-a308-884bcc968c7a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:17.192448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:17.209802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:17.210442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:17.210717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:17.211009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:17.220910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 29 04:33:17.225814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:17.226886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:17.227942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 635/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 29 04:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:17.233137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:17.311421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:17.330730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30537b9f-f1fb-49f9-bbd8-83f67adbfab4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:17.363450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:17.364059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:17.364340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:17.364612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:17.365314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] RBAC: Adding query filter params (name=admin) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:17.365719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:17.367102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:17.375334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 642/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 29 04:33:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:17.380844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:17.497917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007e487-61e7-4c41-a00b-d501b4a3d142 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:17.530021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:17.530643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:17.530922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:17.531194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:17.541394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:17.542879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:17.556388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:17.557415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:17.559026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:17.559026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:17.559026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:17.559026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:17.559026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 636/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:17.563816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:17.662665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7b533-2732-46e1-be79-1c0abe5f9ede None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:17.695880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:17.696490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:17.696777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:17.697052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:17.697773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:17.698083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:17.700019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:17.711287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 643/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:17.717111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:17.747767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:17.814201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b386dee-3c2e-4b8a-ab7b-72a225de55ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:17.845289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:17.845956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:17.846235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:17.846506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:17.853551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:17.855635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 29 04:33:17.866421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:17.867586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:17.869017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 637/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:17.873259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:17.876883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:17.969019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfbdb-afe8-4e6c-90f4-7102ef328c8c None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:18.001214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:18.001846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:18.002129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:18.002402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:18.003179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:18.003487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:18.004898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:18.021524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 644/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 29 04:33:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:18.027199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:18.114349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:18.124364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f9a9-bf26-47b5-b232-bacb1ee39c06 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:18.157068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:18.157706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:18.157988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:18.158258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:18.223133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:18.224576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:18.308823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:18.319197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 638/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 29 04:33:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 29 04:33:18.325507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:18.384128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:18.421027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c5aec-6f97-4741-9d6b-eaf4a2069300 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:18.456459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:18.457090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:18.457369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:18.457675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:18.467986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:18.469412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 29 04:33:18.483452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:18.484509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:18.485637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 29 04:33:18.485637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 29 04:33:18.485637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 29 04:33:18.485637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:18.485637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 645/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:18.490241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:18.585747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86106fe-e571-4cbf-8b7b-458f4bd8a931 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:18.618731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:18.619331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:18.619613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:18.619888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:18.620589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:18.620891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:18.622283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:18.632915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 639/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 29 04:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:18.639122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:18.736323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b65fd9-dff5-4bee-a082-65bb98459837 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:18.750112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:18.770527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:18.771160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:18.771443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:18.771721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:18.778201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:18.779748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 29 04:33:18.791907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:18.792957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: ERROR keystone.server.flask.application Jul 29 04:33:18.794083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 646/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 29 04:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:18.799053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:18.847520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:18.895748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab06792-bf37-4543-b3d5-0b0aa031aa63 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:18.927053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:18.927653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:18.927933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:18.928205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:18.928937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:18.929238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:18.930692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d956-f581-4ed1-886b-01e43818df9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:18.945055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 640/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 29 04:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:18.951807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:19.049809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814f37d-a71b-401a-887d-06b4a70812a1 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:19.082619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:19.083216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:19.083499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:19.083771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:19.084535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] RBAC: Adding query filter params (role.id=cd27725d1b194f6eb7cf2f66863bddfc, scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd, user.id=69d05210f0894bec881969d3ae3ad4f4) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:19.084841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:19.086288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fcc5c-ee07-41a5-81d6-5deb4a994778 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:19.091867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 647/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 29 04:33:18 2022] GET /identity/v3/role_assignments?user.id=69d05210f0894bec881969d3ae3ad4f4&scope.project.id=a55e2cd3f5e44abcbb6c908a7d8552fd&role.id=cd27725d1b194f6eb7cf2f66863bddfc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:21.071988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e823a5-7c40-4075-b512-e5bf30fc7add None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:21.072508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e823a5-7c40-4075-b512-e5bf30fc7add None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:21.072608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e823a5-7c40-4075-b512-e5bf30fc7add None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:21.074553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 641/1288] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:21.079497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:21.079915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:21.080256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:21.097796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:21.098996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:21.127421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:21.163566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 648/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:21.185925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e823a5-7c40-4075-b512-e5bf30fc7add None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:21.284206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e823a5-7c40-4075-b512-e5bf30fc7add None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:21.294732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:21.318006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:21.318633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:21.318918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:21.319198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:21.319814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:21.321180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:21.329935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:21.331124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:21.332331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 642/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:33:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:21.337023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:21.432104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebbd6b-cb03-434c-8a47-6cc0e5e3a5a8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:21.464805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:21.465356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:21.465667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:21.465949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:21.466622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:21.466931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:21.468299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373e294-6469-4ee3-b567-b8771e6321b0 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:21.472992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 649/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 29 04:33:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:21.478469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:21.575376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236b5e-9fe2-42dd-9fa4-98ced80de583 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:21.607613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:21.608207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:21.608493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:21.608772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:21.609434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:21.609780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:21.611143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653d91-75fb-4177-be99-662e4fccf31f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:21.615436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 643/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 29 04:33:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:23.596052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d2c0-ded1-40b8-8d8f-2e7bd38fa589 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:23.596580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d2c0-ded1-40b8-8d8f-2e7bd38fa589 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:23.596693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d2c0-ded1-40b8-8d8f-2e7bd38fa589 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:23.597984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 650/1293] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:23.603069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53908b90-b460-4526-9380-ea694cc1b2d3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:23.603453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53908b90-b460-4526-9380-ea694cc1b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:23.603624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53908b90-b460-4526-9380-ea694cc1b2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:23.621202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-53908b90-b460-4526-9380-ea694cc1b2d3 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:23.622419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-53908b90-b460-4526-9380-ea694cc1b2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:23.652958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:23.694649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 644/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:23.721696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d2c0-ded1-40b8-8d8f-2e7bd38fa589 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:23.753097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:23.824455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d2c0-ded1-40b8-8d8f-2e7bd38fa589 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:23.857868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e71138-be6b-4f13-9e5c-d214e71435f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:23.858403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e71138-be6b-4f13-9e5c-d214e71435f2 None admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:23.858687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e71138-be6b-4f13-9e5c-d214e71435f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:23.858958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e71138-be6b-4f13-9e5c-d214e71435f2 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:23.859636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e71138-be6b-4f13-9e5c-d214e71435f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:23.860993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e71138-be6b-4f13-9e5c-d214e71435f2 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:23.875463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 651/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 29 04:33:23 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:33:25.892306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9e0d7-cf26-461e-9e6e-4ea32a677f52 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:25.892859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9e0d7-cf26-461e-9e6e-4ea32a677f52 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:25.892859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9e0d7-cf26-461e-9e6e-4ea32a677f52 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:25.894251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 645/1296] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:25.899337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:25.899737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:25.899895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:25.918439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:25.919633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:25.991284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 652/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:26.014074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9e0d7-cf26-461e-9e6e-4ea32a677f52 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:26.114264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9e0d7-cf26-461e-9e6e-4ea32a677f52 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:26.146870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:26.147437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:26.147719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:26.147995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:26.148606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:26.150007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:26.159193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:26.160361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:26.161546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 646/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:33:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:26.166539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:26.188627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:26.268199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d6e4-f87e-4251-a8be-f1649782db2d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:26.301281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:26.301935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:26.302223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:26.302502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:26.303188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:26.303496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:26.304861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:26.310421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 653/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 29 04:33:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:26.316360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:26.347885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:26.414455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610fbad-a192-4292-8878-3a01d828b5e1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:26.446524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:26.447117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:26.447395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:26.447667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:26.448975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] RBAC: Adding query filter params (interface=public, service_id=c7ef011a906b460f89112f33b8cd4632, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:26.449281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:26.450666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998e496-820b-4a70-83d0-7b2f44373ab7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:26.455423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 647/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 29 04:33:26 2022] GET /identity/v3/endpoints?service_id=c7ef011a906b460f89112f33b8cd4632&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:26.460990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:26.539171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:26.558281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceffb76-aaaa-4124-9c43-f2651f939077 None admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:26.591216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c45b11-cad3-4219-95c0-d611e410d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:26.591822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45b11-cad3-4219-95c0-d611e410d2fe None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:26.592105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45b11-cad3-4219-95c0-d611e410d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:26.592386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c45b11-cad3-4219-95c0-d611e410d2fe None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:26.593028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c45b11-cad3-4219-95c0-d611e410d2fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:26.594417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c45b11-cad3-4219-95c0-d611e410d2fe None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:26.601028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 654/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 29 04:33:26 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:33:28.626590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e534e-f8ac-43af-8ded-1d0e1f5a4c2f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:28.627134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e534e-f8ac-43af-8ded-1d0e1f5a4c2f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:28.627134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e534e-f8ac-43af-8ded-1d0e1f5a4c2f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:28.628488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 648/1302] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:33:28.633484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:28.633874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:28.634085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:28.652123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:33:28.653317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:33:28.737709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 655/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:33:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 29 04:33:28.761671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e534e-f8ac-43af-8ded-1d0e1f5a4c2f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:28.855172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:28.862148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e534e-f8ac-43af-8ded-1d0e1f5a4c2f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:28.894673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe59215-c749-4159-98d2-62da355a839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:28.895242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe59215-c749-4159-98d2-62da355a839b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:28.895527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe59215-c749-4159-98d2-62da355a839b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:28.895804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe59215-c749-4159-98d2-62da355a839b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:28.896420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe59215-c749-4159-98d2-62da355a839b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:28.897809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe59215-c749-4159-98d2-62da355a839b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-efe59215-c749-4159-98d2-62da355a839b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 29 04:33:28.906498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 29 04:33:28.907637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 29 04:33:28.908657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 649/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 29 04:33:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 29 04:33:28.913723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:28.986559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:29.009236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b848b8-7a57-4dc7-a749-70ccb20be30a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:29.041753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:29.042864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:29.043149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:29.043453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] PATH_INFO: `/v3/services` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:29.044135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:33:29.044470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:29.045858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe18a-a79a-4e26-8aad-613306bcff4f None admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:29.050848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 656/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 29 04:33:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:33:29.056604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe59215-c749-4159-98d2-62da355a839b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:33:29.152800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe59215-c749-4159-98d2-62da355a839b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:33:29.185800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706fac1-3a7c-44dd-ab82-d6a745fc2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:33:29.186398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706fac1-3a7c-44dd-ab82-d6a745fc2223 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:33:29.186678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706fac1-3a7c-44dd-ab82-d6a745fc2223 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:33:29.186953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706fac1-3a7c-44dd-ab82-d6a745fc2223 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:33:29.187652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706fac1-3a7c-44dd-ab82-d6a745fc2223 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:33:29.189000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706fac1-3a7c-44dd-ab82-d6a745fc2223 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:33:29.207461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 650/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:33:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:33:39.047944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=30 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:33:39.203508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:31.742480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5a7f-b3cc-4ba8-8ae5-d8c5c4c62d27 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:31.743033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5a7f-b3cc-4ba8-8ae5-d8c5c4c62d27 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:31.743033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5a7f-b3cc-4ba8-8ae5-d8c5c4c62d27 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:31.748181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 657/1307] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:31.750100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955401c-7d86-40b6-8e21-bcfe4959a00a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:31.750907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955401c-7d86-40b6-8e21-bcfe4959a00a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:31.751394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955401c-7d86-40b6-8e21-bcfe4959a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:31.828350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1955401c-7d86-40b6-8e21-bcfe4959a00a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:31.829752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1955401c-7d86-40b6-8e21-bcfe4959a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:31.957976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 651/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:31.993755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ea993-fc3c-475f-9dc9-1150eb711378 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:31.993980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ea993-fc3c-475f-9dc9-1150eb711378 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:31.994264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ea993-fc3c-475f-9dc9-1150eb711378 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:31.995993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 658/1309] 10.222.0.46 () {54 vars in 965 bytes} [Fri Jul 29 04:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:32.001899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50c7a-ac91-4f9d-953e-fc3e4f134da9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:32.002119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50c7a-ac91-4f9d-953e-fc3e4f134da9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:32.002421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad50c7a-ac91-4f9d-953e-fc3e4f134da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:32.092646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7ad50c7a-ac91-4f9d-953e-fc3e4f134da9 None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:32.093906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7ad50c7a-ac91-4f9d-953e-fc3e4f134da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:32.116378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:32.184374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 652/1310] 10.222.0.46 () {58 vars in 1062 bytes} [Fri Jul 29 04:34:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:32.186899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ea993-fc3c-475f-9dc9-1150eb711378 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:32.188777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-044ea993-fc3c-475f-9dc9-1150eb711378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:32.324500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ea993-fc3c-475f-9dc9-1150eb711378 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:32.398574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:32.399199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:32.399486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:32.399777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:32.401393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:32.461682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:32.518555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:32.519995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec49c2-2b29-4a16-85c4-e6a931c8158c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:32.540800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 659/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:34.888331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa9d2c-161a-4054-ac8a-12ea5c635618 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:34.888894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa9d2c-161a-4054-ac8a-12ea5c635618 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:34.888894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa9d2c-161a-4054-ac8a-12ea5c635618 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:34.890247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 653/1312] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:34.895500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cf2a-d39f-48b9-bd0f-b1e8c3c9a7fa None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:34.895903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cf2a-d39f-48b9-bd0f-b1e8c3c9a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:34.896053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9cf2a-d39f-48b9-bd0f-b1e8c3c9a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:34.977311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-69f9cf2a-d39f-48b9-bd0f-b1e8c3c9a7fa None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:34.978572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-69f9cf2a-d39f-48b9-bd0f-b1e8c3c9a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:35.094400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 660/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:35.133844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa9d2c-161a-4054-ac8a-12ea5c635618 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:35.135393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ddfa9d2c-161a-4054-ac8a-12ea5c635618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:35.247082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa9d2c-161a-4054-ac8a-12ea5c635618 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:35.321748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:35.324871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:35.325614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:35.325969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:35.326673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:35.329045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:35.447550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:35.449173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee1f21-67a9-438c-aa02-8c2a0d327d93 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:35.470043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 654/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:37.793675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd1b7-1c87-4ba1-a2ce-a5194893fb8c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:37.794211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd1b7-1c87-4ba1-a2ce-a5194893fb8c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:37.794211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd1b7-1c87-4ba1-a2ce-a5194893fb8c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:37.795591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 661/1315] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:37.800726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8b3bc-3b57-430c-a511-113f1fe9e158 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:37.801401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8b3bc-3b57-430c-a511-113f1fe9e158 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:37.801401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8b3bc-3b57-430c-a511-113f1fe9e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:37.867962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f3e8b3bc-3b57-430c-a511-113f1fe9e158 None None] MFA Rules not processed for user `9ebc69562ea14501b1b66e60c7ca23d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:37.869166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f3e8b3bc-3b57-430c-a511-113f1fe9e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:37.920098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:37.964025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 655/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:38.004588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd1b7-1c87-4ba1-a2ce-a5194893fb8c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:38.006174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2dbbd1b7-1c87-4ba1-a2ce-a5194893fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:38.015780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:38.109363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd1b7-1c87-4ba1-a2ce-a5194893fb8c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:38.181526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:38.182167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:38.182447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:38.182719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:38.184338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:38.246451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:38.293300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:38.294797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47def93-b4e4-4cac-b07c-1c1f61c597b3 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:38.312275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 662/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:40.853562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8e90-8001-48c7-b93a-233f6b45790c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:40.854154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8e90-8001-48c7-b93a-233f6b45790c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:40.854154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8e90-8001-48c7-b93a-233f6b45790c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:40.855482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 656/1318] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:40.860489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48615-91b0-44bb-b710-baa992707728 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:40.860927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48615-91b0-44bb-b710-baa992707728 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:40.861052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48615-91b0-44bb-b710-baa992707728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:40.925793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-09e48615-91b0-44bb-b710-baa992707728 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:40.927032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-09e48615-91b0-44bb-b710-baa992707728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:41.024495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 663/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:41.063236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8e90-8001-48c7-b93a-233f6b45790c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:41.064809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d48e8e90-8001-48c7-b93a-233f6b45790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:41.165413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8e90-8001-48c7-b93a-233f6b45790c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:41.235576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:41.236178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:41.236453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:41.236720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:41.238333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:41.245384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:41.343467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:41.344887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270ecf5-1678-414c-995d-5a42c2f2aaa4 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:41.362297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 657/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:44.073943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b143b-df61-49f5-8ef7-4dcbd87dfa7d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:44.074467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b143b-df61-49f5-8ef7-4dcbd87dfa7d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:44.074467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b143b-df61-49f5-8ef7-4dcbd87dfa7d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:44.075871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 664/1321] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:44.081227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff33e-09b8-4651-879e-e84239edda05 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:44.081702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff33e-09b8-4651-879e-e84239edda05 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:44.081829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff33e-09b8-4651-879e-e84239edda05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:44.148524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-412ff33e-09b8-4651-879e-e84239edda05 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:44.149804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-412ff33e-09b8-4651-879e-e84239edda05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:44.214362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:44.259673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 658/1322] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:44.297064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b143b-df61-49f5-8ef7-4dcbd87dfa7d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:44.298652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8b4b143b-df61-49f5-8ef7-4dcbd87dfa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:44.320005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:44.406793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b143b-df61-49f5-8ef7-4dcbd87dfa7d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:44.479442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:44.479991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:44.480273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:44.480549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:44.482224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:44.552505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:44.594587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:44.595943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edebe6-320f-47fe-baaa-b8bc122781ab service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:44.616022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 665/1323] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:46.710910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f9c2-a524-4721-8747-1c2dd4c0d7e2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:46.711436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f9c2-a524-4721-8747-1c2dd4c0d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:46.711436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0f9c2-a524-4721-8747-1c2dd4c0d7e2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:46.712968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 659/1324] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:46.718121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66b99-fd07-4e58-9b09-51ab67f4c88a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:46.718561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66b99-fd07-4e58-9b09-51ab67f4c88a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:46.718654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66b99-fd07-4e58-9b09-51ab67f4c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:46.789913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e3f66b99-fd07-4e58-9b09-51ab67f4c88a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:46.791142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e3f66b99-fd07-4e58-9b09-51ab67f4c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:46.888958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 666/1325] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:34:46.925393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f9c2-a524-4721-8747-1c2dd4c0d7e2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:46.927004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-11b0f9c2-a524-4721-8747-1c2dd4c0d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:47.035671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0f9c2-a524-4721-8747-1c2dd4c0d7e2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:47.114711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:47.115328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:47.115608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:47.115879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:47.118172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:47.134528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:47.226428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:47.227816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c5d93-d554-4ec9-bde7-d804204e6abd service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:47.255105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 660/1326] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:49.337364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d809-d219-47b0-8887-53adcaacfd28 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:49.337985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d809-d219-47b0-8887-53adcaacfd28 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:49.337985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d809-d219-47b0-8887-53adcaacfd28 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:49.339291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 667/1327] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:49.344605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ded6ab-7533-4567-83db-fe8ed73b6054 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:49.345023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ded6ab-7533-4567-83db-fe8ed73b6054 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:49.345171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ded6ab-7533-4567-83db-fe8ed73b6054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:49.413465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-74ded6ab-7533-4567-83db-fe8ed73b6054 None None] MFA Rules not processed for user `9ebc69562ea14501b1b66e60c7ca23d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:49.414959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-74ded6ab-7533-4567-83db-fe8ed73b6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:49.482052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:49.514986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 661/1328] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:49.551399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d809-d219-47b0-8887-53adcaacfd28 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:49.553027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d257d809-d219-47b0-8887-53adcaacfd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:49.585451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:49.657012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d809-d219-47b0-8887-53adcaacfd28 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:49.731266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:49.731940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:49.732224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:49.732496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:49.734120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:49.817078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:49.849928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:49.851404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658db07d-dfbc-4041-b082-ec7fd31f0fe8 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:49.878027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 668/1329] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:52.143843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5518-c408-4590-96f1-cbaef49e82ab None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:52.144375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5518-c408-4590-96f1-cbaef49e82ab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:52.144375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5518-c408-4590-96f1-cbaef49e82ab None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:52.145673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 662/1330] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:52.151370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9084-50ed-451f-96a2-1f3bf85c97ec None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:52.151781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9084-50ed-451f-96a2-1f3bf85c97ec None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:52.151937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9084-50ed-451f-96a2-1f3bf85c97ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:52.217659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b82c9084-50ed-451f-96a2-1f3bf85c97ec None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:52.218866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b82c9084-50ed-451f-96a2-1f3bf85c97ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:52.312081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 669/1331] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:34:52.348689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5518-c408-4590-96f1-cbaef49e82ab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:52.350312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1cec5518-c408-4590-96f1-cbaef49e82ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:52.453260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5518-c408-4590-96f1-cbaef49e82ab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:52.523544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:52.524179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:52.524457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:52.524722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:52.526357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:52.552070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:52.634651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:52.636097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068758b-d7fd-4a19-836a-ff5177404351 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:52.653890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 663/1332] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:54.704125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aeb7b-b8dd-40a3-b59b-248ef5de4de8 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:54.704681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aeb7b-b8dd-40a3-b59b-248ef5de4de8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:54.704681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aeb7b-b8dd-40a3-b59b-248ef5de4de8 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:54.706069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 670/1333] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:54.711758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34399522-ea59-48a6-8500-96aa4d234358 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:54.712158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34399522-ea59-48a6-8500-96aa4d234358 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:54.712322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34399522-ea59-48a6-8500-96aa4d234358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:54.783131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-34399522-ea59-48a6-8500-96aa4d234358 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:54.784342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34399522-ea59-48a6-8500-96aa4d234358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:54.858828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:54.882297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 664/1334] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:54.922519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aeb7b-b8dd-40a3-b59b-248ef5de4de8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:54.924056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a96aeb7b-b8dd-40a3-b59b-248ef5de4de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:54.964356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:55.028895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aeb7b-b8dd-40a3-b59b-248ef5de4de8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:55.101191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:55.101843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:55.102128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:55.102407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:55.104027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:55.185756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:55.211503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:55.212931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd64554-8c9f-4b1e-9c22-11ef5ae535dd service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:55.231390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 671/1335] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:34:57.577108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f9d1-412e-4495-8ea2-3df941ea9559 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:57.577698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f9d1-412e-4495-8ea2-3df941ea9559 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:57.577698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8f9d1-412e-4495-8ea2-3df941ea9559 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:57.579178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 665/1336] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:34:57.585205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42207-c2b3-43eb-badc-50864dd03e27 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:57.585872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42207-c2b3-43eb-badc-50864dd03e27 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:57.585872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42207-c2b3-43eb-badc-50864dd03e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:57.649918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6ba42207-c2b3-43eb-badc-50864dd03e27 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:34:57.651109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6ba42207-c2b3-43eb-badc-50864dd03e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:57.748755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 672/1337] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:34:57.784701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f9d1-412e-4495-8ea2-3df941ea9559 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:34:57.786266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-03b8f9d1-412e-4495-8ea2-3df941ea9559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:57.887494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8f9d1-412e-4495-8ea2-3df941ea9559 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:34:57.960951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:34:57.961570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:34:57.961894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:34:57.962180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:34:57.963801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:34:57.999949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:34:58.085442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:34:58.087405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b0411-08ef-4207-a786-7e362e5c2a32 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:34:58.106460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 666/1338] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:34:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:02.067400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e9494-7152-48ef-a44c-0630e47c0c71 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:02.067885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e9494-7152-48ef-a44c-0630e47c0c71 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:02.067976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e9494-7152-48ef-a44c-0630e47c0c71 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:02.069913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 673/1339] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:02.074981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dea56-33b0-45d7-98ea-92c24f4878ae None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:02.075396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dea56-33b0-45d7-98ea-92c24f4878ae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:02.075544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dea56-33b0-45d7-98ea-92c24f4878ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:02.141473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f00dea56-33b0-45d7-98ea-92c24f4878ae None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:02.142729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f00dea56-33b0-45d7-98ea-92c24f4878ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:02.230838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:02.243517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 667/1340] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:02.282918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e9494-7152-48ef-a44c-0630e47c0c71 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:02.284576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-710e9494-7152-48ef-a44c-0630e47c0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:02.332729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:02.387994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e9494-7152-48ef-a44c-0630e47c0c71 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:02.467262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:02.467880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:02.468163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:02.468439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:02.470097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:02.561714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:02.579304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:02.580730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4354c-f459-4d3a-9812-5477265fbb54 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:02.599232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 674/1341] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:05.240340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c04e2-066f-403c-95e2-8e7f3342e9a2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:05.240893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c04e2-066f-403c-95e2-8e7f3342e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:05.240893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c04e2-066f-403c-95e2-8e7f3342e9a2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:05.242278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 668/1342] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:05.248006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4262-089e-4380-9a4c-4521e85a3b83 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:05.248600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4262-089e-4380-9a4c-4521e85a3b83 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:05.248696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4262-089e-4380-9a4c-4521e85a3b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:05.321916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-320b4262-089e-4380-9a4c-4521e85a3b83 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:05.323182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-320b4262-089e-4380-9a4c-4521e85a3b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:05.430090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 675/1343] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:05.468891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c04e2-066f-403c-95e2-8e7f3342e9a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:05.470529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-193c04e2-066f-403c-95e2-8e7f3342e9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:05.576691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c04e2-066f-403c-95e2-8e7f3342e9a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:05.650390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:05.650930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:05.651212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:05.651488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:05.653134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:05.697929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:05.768325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:05.769815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3472fb-9fb4-4f5a-8841-bd33aaedd26d service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:05.789177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 669/1344] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:09.786616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325cce-d56b-4550-8ec3-a82f22deaf80 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:09.787196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325cce-d56b-4550-8ec3-a82f22deaf80 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:09.787196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93325cce-d56b-4550-8ec3-a82f22deaf80 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:09.788800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 676/1345] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:09.794175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ce64-fa97-413b-ba72-39a8f827135f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:09.794583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ce64-fa97-413b-ba72-39a8f827135f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:09.794804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01ce64-fa97-413b-ba72-39a8f827135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:09.863303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8b01ce64-fa97-413b-ba72-39a8f827135f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:09.864535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b01ce64-fa97-413b-ba72-39a8f827135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:09.983212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:09.994367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 670/1346] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:10.023509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93325cce-d56b-4550-8ec3-a82f22deaf80 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:10.025044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-93325cce-d56b-4550-8ec3-a82f22deaf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:10.089914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:10.141337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93325cce-d56b-4550-8ec3-a82f22deaf80 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:10.218419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:10.218961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:10.219241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:10.219515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:10.221137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:10.332355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:10.336109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:10.338151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91a1a9-1c5a-4384-9b94-f8da326e5a27 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:10.357374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 677/1347] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:15.276706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedad9cc-ebfe-4a6d-a5d8-172be371b9d5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:15.277523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedad9cc-ebfe-4a6d-a5d8-172be371b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:15.279431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedad9cc-ebfe-4a6d-a5d8-172be371b9d5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:15.281865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 671/1348] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:15.288115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e481101-27ef-4b60-a317-0f0dd1a44e7d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:15.288115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e481101-27ef-4b60-a317-0f0dd1a44e7d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:15.288923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e481101-27ef-4b60-a317-0f0dd1a44e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:15.394116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4e481101-27ef-4b60-a317-0f0dd1a44e7d None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:15.395405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e481101-27ef-4b60-a317-0f0dd1a44e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:15.608649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 678/1349] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:35:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:19.646874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866f5a-2f48-4a79-9398-fd21cf890aef None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:19.647737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866f5a-2f48-4a79-9398-fd21cf890aef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:19.648021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866f5a-2f48-4a79-9398-fd21cf890aef None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:19.649360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 672/1350] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:19.654303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685be4-0de6-4797-9c5b-be6948cc3f6b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:19.654713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685be4-0de6-4797-9c5b-be6948cc3f6b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:19.654981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685be4-0de6-4797-9c5b-be6948cc3f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:19.718322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:19.744124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f7685be4-0de6-4797-9c5b-be6948cc3f6b None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:19.745348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f7685be4-0de6-4797-9c5b-be6948cc3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:19.857167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 679/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:35:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:21.319609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55c33-3e85-4294-9273-7f2e12f7ac83 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:21.320230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55c33-3e85-4294-9273-7f2e12f7ac83 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:21.320230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55c33-3e85-4294-9273-7f2e12f7ac83 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:21.321755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 673/1352] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:21.326963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f483-f93f-428f-8e26-df5036417798 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:21.327427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f483-f93f-428f-8e26-df5036417798 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:21.327553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f483-f93f-428f-8e26-df5036417798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:21.405010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2df9f483-f93f-428f-8e26-df5036417798 None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:21.406254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2df9f483-f93f-428f-8e26-df5036417798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:21.456188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:21.524064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 680/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:24.906442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ea700-300d-41f0-be04-ab9a1676f656 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:24.908667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ea700-300d-41f0-be04-ab9a1676f656 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:24.908667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ea700-300d-41f0-be04-ab9a1676f656 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:24.909489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 674/1354] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:24.915659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaf35-2b8a-484d-8969-60e84b717ab8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:24.916127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaf35-2b8a-484d-8969-60e84b717ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:24.916208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaf35-2b8a-484d-8969-60e84b717ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:25.018043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-736aaf35-2b8a-484d-8969-60e84b717ab8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:25.019243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-736aaf35-2b8a-484d-8969-60e84b717ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:25.119361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 681/1355] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:25.180330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5a3af-c49a-4551-a5d3-b851bb2d980b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:25.180789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5a3af-c49a-4551-a5d3-b851bb2d980b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:25.181832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5a3af-c49a-4551-a5d3-b851bb2d980b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:25.183894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 675/1356] 10.222.0.46 () {54 vars in 962 bytes} [Fri Jul 29 04:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:25.190468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1655b-65c4-446e-ada4-4a0503b15505 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:25.190830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1655b-65c4-446e-ada4-4a0503b15505 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:25.191176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1655b-65c4-446e-ada4-4a0503b15505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:25.210454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:25.274277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-60c1655b-65c4-446e-ada4-4a0503b15505 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:25.275467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-60c1655b-65c4-446e-ada4-4a0503b15505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:25.396495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 682/1357] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Jul 29 04:35:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:25.407189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5a3af-c49a-4551-a5d3-b851bb2d980b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:25.409703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-40c5a3af-c49a-4551-a5d3-b851bb2d980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:25.568178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5a3af-c49a-4551-a5d3-b851bb2d980b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:25.650009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:25.693561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:25.694411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:25.694791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:25.695089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:25.696767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:25.791371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:25.792949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884f1c-c4f6-4c8e-bb87-1287b5d5f7aa service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:25.812766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 676/1358] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:35:28.043194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808fee9-5e26-4212-b645-92f95ec5906f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:28.043729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808fee9-5e26-4212-b645-92f95ec5906f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:28.043729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808fee9-5e26-4212-b645-92f95ec5906f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:28.045066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 683/1359] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:28.050311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60812-1a06-4f18-b230-433e850e459f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:28.051100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60812-1a06-4f18-b230-433e850e459f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:28.051921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60812-1a06-4f18-b230-433e850e459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:28.120438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b9c60812-1a06-4f18-b230-433e850e459f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:28.121660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b9c60812-1a06-4f18-b230-433e850e459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:28.167320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:28.241742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 677/1360] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:28.280965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808fee9-5e26-4212-b645-92f95ec5906f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:28.282570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1808fee9-5e26-4212-b645-92f95ec5906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:28.370474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:28.460437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808fee9-5e26-4212-b645-92f95ec5906f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:28.595272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:28.595896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:28.596177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:28.596451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:28.598151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:28.621840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:28.694486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:28.696085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a76ff-5309-4201-9e22-ca61ee6a5c8a service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:28.715397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 684/1361] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:35:31.094621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3059-e1d0-4d51-8e74-d1623101bd32 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:31.095134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3059-e1d0-4d51-8e74-d1623101bd32 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:31.095250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c3059-e1d0-4d51-8e74-d1623101bd32 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:31.096560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 678/1362] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:31.102118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495b3a-f5ef-4a18-844c-bc7814db4579 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:31.102579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495b3a-f5ef-4a18-844c-bc7814db4579 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:31.102659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495b3a-f5ef-4a18-844c-bc7814db4579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:31.178529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-79495b3a-f5ef-4a18-844c-bc7814db4579 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:31.179824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-79495b3a-f5ef-4a18-844c-bc7814db4579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:31.281723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:31.286020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 685/1363] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:31.332182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fc53-f1b4-480c-a79d-3c0e0894f226 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:31.332475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fc53-f1b4-480c-a79d-3c0e0894f226 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:31.332761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fc53-f1b4-480c-a79d-3c0e0894f226 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:31.334802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 679/1364] 10.222.0.46 () {54 vars in 962 bytes} [Fri Jul 29 04:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:35:31.340209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67dda-83ee-45ba-919b-7ed85c1483fb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:31.340550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67dda-83ee-45ba-919b-7ed85c1483fb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:31.340831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67dda-83ee-45ba-919b-7ed85c1483fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:31.420143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6ff67dda-83ee-45ba-919b-7ed85c1483fb None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:31.421381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6ff67dda-83ee-45ba-919b-7ed85c1483fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:31.542336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 686/1365] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Jul 29 04:35:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:31.550453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5fc53-f1b4-480c-a79d-3c0e0894f226 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:31.552209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dca5fc53-f1b4-480c-a79d-3c0e0894f226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:31.725039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5fc53-f1b4-480c-a79d-3c0e0894f226 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:31.756190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:31.863805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:31.864428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:31.864710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:31.865021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:31.866695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:31.969344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:31.970997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c60b8-274d-42c0-adfd-967edf09d9e3 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:31.990225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 680/1366] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:32.944740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0373a-513b-4da4-be5b-ebdea7d0f496 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:32.945262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0373a-513b-4da4-be5b-ebdea7d0f496 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:32.945357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0373a-513b-4da4-be5b-ebdea7d0f496 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:32.946832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 687/1367] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:32.951761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40e3a6-3a5f-43ac-a162-ae78be545024 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:32.952164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40e3a6-3a5f-43ac-a162-ae78be545024 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:32.952346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40e3a6-3a5f-43ac-a162-ae78be545024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:32.985502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:33.024324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2d40e3a6-3a5f-43ac-a162-ae78be545024 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:33.025539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d40e3a6-3a5f-43ac-a162-ae78be545024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:33.130299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 681/1368] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:33.478231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342f6b-0bbe-4212-aa17-7c5cc73e636b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:33.478231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342f6b-0bbe-4212-aa17-7c5cc73e636b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:33.478231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342f6b-0bbe-4212-aa17-7c5cc73e636b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:33.481936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 688/1369] 10.222.0.46 () {54 vars in 964 bytes} [Fri Jul 29 04:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:33.485739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0ea0-5f29-4053-a1f1-654e7bbea2c7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:33.485739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0ea0-5f29-4053-a1f1-654e7bbea2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:33.485739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0ea0-5f29-4053-a1f1-654e7bbea2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:33.567158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-798a0ea0-5f29-4053-a1f1-654e7bbea2c7 None None] MFA Rules not processed for user `18adc9c4a6514351ba0d9df140578a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:33.568475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-798a0ea0-5f29-4053-a1f1-654e7bbea2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:33.618276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:33.660196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342f6b-0bbe-4212-aa17-7c5cc73e636b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:33.662486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7c342f6b-0bbe-4212-aa17-7c5cc73e636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:33.665900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 682/1370] 10.222.0.46 () {58 vars in 1061 bytes} [Fri Jul 29 04:35:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:33.722358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:33.786103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342f6b-0bbe-4212-aa17-7c5cc73e636b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:33.866920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:33.867702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:33.868108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:33.868485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:33.870245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:34.081067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727dfb-878a-4a0f-95d0-6b885effaefb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:34.081552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727dfb-878a-4a0f-95d0-6b885effaefb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:34.081886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727dfb-878a-4a0f-95d0-6b885effaefb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:34.083831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 683/1371] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:35:34.088294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159bb7-d3f8-4589-b0ea-4376f381daaa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:34.088584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159bb7-d3f8-4589-b0ea-4376f381daaa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:34.088899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159bb7-d3f8-4589-b0ea-4376f381daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:34.115119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:34.131844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:34.133159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:34.164903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ed159bb7-d3f8-4589-b0ea-4376f381daaa None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:34.165005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 689/1372] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:34.166070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ed159bb7-d3f8-4589-b0ea-4376f381daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:34.278075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 684/1373] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:35:34.324955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:34.326031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:34.430794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d49e-6cf3-4d99-8aa9-7ba5627200b3 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:34.531678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:34.544691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:34.545338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:34.545641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:34.545921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:34.547566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:34.634665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:34.636252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b171-da2e-4b46-b137-34c6496357a9 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:34.654448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 690/1374] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:36.695462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138d5f-cae7-4638-a7b8-43c073c71904 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:36.696005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138d5f-cae7-4638-a7b8-43c073c71904 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:36.696005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138d5f-cae7-4638-a7b8-43c073c71904 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:36.697364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 685/1375] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:36.702942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be2d9-2b87-4c02-981c-3b1889892ec5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:36.703384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be2d9-2b87-4c02-981c-3b1889892ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:36.703489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be2d9-2b87-4c02-981c-3b1889892ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:36.773589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-930be2d9-2b87-4c02-981c-3b1889892ec5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:36.774766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-930be2d9-2b87-4c02-981c-3b1889892ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:36.833757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:36.873184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 691/1376] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:36.926800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138d5f-cae7-4638-a7b8-43c073c71904 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:36.928328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a9138d5f-cae7-4638-a7b8-43c073c71904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:36.983883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:37.088002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138d5f-cae7-4638-a7b8-43c073c71904 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:37.220444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:37.220983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:37.221262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:37.221533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:37.223195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:37.234572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:37.311766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:37.313358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5dd1a-3b11-4f7a-83a5-77437691e745 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:37.331898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 686/1377] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:39.359745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c7cc-a43d-4619-a435-95f567195ea7 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:39.360157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c7cc-a43d-4619-a435-95f567195ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:39.360322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c7cc-a43d-4619-a435-95f567195ea7 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:39.361854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 692/1378] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:39.367038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0e13-dc3c-44a8-bba1-da461ddc49ff None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:39.367978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0e13-dc3c-44a8-bba1-da461ddc49ff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:39.368575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0e13-dc3c-44a8-bba1-da461ddc49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:39.446253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-205b0e13-dc3c-44a8-bba1-da461ddc49ff None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:39.447475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-205b0e13-dc3c-44a8-bba1-da461ddc49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:39.537552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:39.550878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 687/1379] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:39.594891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c7cc-a43d-4619-a435-95f567195ea7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:39.596405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fef6c7cc-a43d-4619-a435-95f567195ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:39.764008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c7cc-a43d-4619-a435-95f567195ea7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:39.815016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:39.884914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:39.885452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:39.885765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:39.886040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:39.887659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:39.987209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:39.989347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c326555-f679-47fb-bf13-b991e063ef10 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:40.018289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 693/1380] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:42.057885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d633-028c-45e0-8f0d-abab36f1dbef None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:42.058438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d633-028c-45e0-8f0d-abab36f1dbef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:42.058898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d633-028c-45e0-8f0d-abab36f1dbef None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:42.060648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 688/1381] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:42.065703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba878f-76c7-40b1-bf25-5eea34faebec None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:42.066118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba878f-76c7-40b1-bf25-5eea34faebec None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:42.066309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba878f-76c7-40b1-bf25-5eea34faebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:42.132480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-49ba878f-76c7-40b1-bf25-5eea34faebec None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:42.133728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-49ba878f-76c7-40b1-bf25-5eea34faebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:42.135793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:42.233261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 694/1382] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:42.276611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d633-028c-45e0-8f0d-abab36f1dbef None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:42.278987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3ca1d633-028c-45e0-8f0d-abab36f1dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:42.480667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d633-028c-45e0-8f0d-abab36f1dbef None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:42.554877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:42.609551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:42.610223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:42.610513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:42.610796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:42.612489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:42.708789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:42.710646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902991-5237-4dc5-bdda-a9712b31afa9 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:42.732214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 689/1383] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:44.739484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23e865-7ec5-44a1-946a-36e8f1b4c563 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:44.740187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23e865-7ec5-44a1-946a-36e8f1b4c563 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:44.740187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23e865-7ec5-44a1-946a-36e8f1b4c563 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:44.741901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 695/1384] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:44.747089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c079b6-2238-4ff8-8ec6-7888396b0aa9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:44.747570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c079b6-2238-4ff8-8ec6-7888396b0aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:44.747741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c079b6-2238-4ff8-8ec6-7888396b0aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:44.825946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-63c079b6-2238-4ff8-8ec6-7888396b0aa9 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:44.827467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-63c079b6-2238-4ff8-8ec6-7888396b0aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:44.860166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:44.937588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 690/1385] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:44.988166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23e865-7ec5-44a1-946a-36e8f1b4c563 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:44.990421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bd23e865-7ec5-44a1-946a-36e8f1b4c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:45.135951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:45.157892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23e865-7ec5-44a1-946a-36e8f1b4c563 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:45.294882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:45.295357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:45.295634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:45.295908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:45.297511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:45.387081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:45.388704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191d2f4-7796-4f54-a03a-677df531d8ac service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:45.393866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:45.409055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 696/1386] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:47.568817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774c25-a833-4dd6-b171-0a0899006375 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:47.569350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774c25-a833-4dd6-b171-0a0899006375 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:47.569350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774c25-a833-4dd6-b171-0a0899006375 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:47.570760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 691/1387] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:47.576196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e666e-7fe1-46da-a273-9ccb644cf253 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:47.576604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e666e-7fe1-46da-a273-9ccb644cf253 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:47.576757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e666e-7fe1-46da-a273-9ccb644cf253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:47.642115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-431e666e-7fe1-46da-a273-9ccb644cf253 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:47.643325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-431e666e-7fe1-46da-a273-9ccb644cf253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:47.740673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 697/1388] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:47.789394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774c25-a833-4dd6-b171-0a0899006375 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:47.791079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c774c25-a833-4dd6-b171-0a0899006375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:47.938795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774c25-a833-4dd6-b171-0a0899006375 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:47.949551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:48.055430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:48.055959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:48.056239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:48.056515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:48.058180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:48.152670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:48.154297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cf1a3-2aad-447d-bc71-dd71d58addc4 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:48.172315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 692/1389] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:49.285616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958be71-c6db-49c1-9a81-18c5662bb446 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:49.286179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958be71-c6db-49c1-9a81-18c5662bb446 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:49.286179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958be71-c6db-49c1-9a81-18c5662bb446 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:49.287547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 698/1390] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:49.293073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d530-725b-4c3a-8f7b-da13ee825ea2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:49.293498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d530-725b-4c3a-8f7b-da13ee825ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:49.293696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d530-725b-4c3a-8f7b-da13ee825ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:49.309824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:49.363954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2d36d530-725b-4c3a-8f7b-da13ee825ea2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:49.365341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d36d530-725b-4c3a-8f7b-da13ee825ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:49.462511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 693/1391] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:49.517710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9f5b-b6e7-41b9-b08a-7cf13e0fe743 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:49.518001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9f5b-b6e7-41b9-b08a-7cf13e0fe743 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:49.518278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9f5b-b6e7-41b9-b08a-7cf13e0fe743 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:49.520276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 699/1392] 10.222.0.46 () {54 vars in 966 bytes} [Fri Jul 29 04:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:49.525337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4341-0b9e-4549-9899-c08265968ecd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:49.525739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4341-0b9e-4549-9899-c08265968ecd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:49.526135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4341-0b9e-4549-9899-c08265968ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:49.602632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e3b4341-0b9e-4549-9899-c08265968ecd None None] MFA Rules not processed for user `0dddbf2245fc4a71b91102e821f177ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:49.603752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e3b4341-0b9e-4549-9899-c08265968ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:49.638735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:49.681944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 694/1393] 10.222.0.46 () {58 vars in 1063 bytes} [Fri Jul 29 04:35:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:49.689688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c9f5b-b6e7-41b9-b08a-7cf13e0fe743 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:49.692120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d5c9f5b-b6e7-41b9-b08a-7cf13e0fe743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:49.764211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:49.795471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c9f5b-b6e7-41b9-b08a-7cf13e0fe743 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:49.869364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:49.869947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:49.870234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:49.870504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:49.872125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:49.985618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:49.987045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8eaf3-a7dc-4201-bde1-4b175468f891 service glance] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:50.002707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:50.007954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 700/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:50.239489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8844-faa3-42f3-9c12-a150230cf17c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:50.239791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8844-faa3-42f3-9c12-a150230cf17c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:50.240054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8844-faa3-42f3-9c12-a150230cf17c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:50.241438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 695/1395] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:50.247430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d6124-8f9b-4665-b160-e59813100235 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:50.247809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d6124-8f9b-4665-b160-e59813100235 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:50.248095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d6124-8f9b-4665-b160-e59813100235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:50.321151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1a5d6124-8f9b-4665-b160-e59813100235 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:50.322553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1a5d6124-8f9b-4665-b160-e59813100235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:50.429679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 701/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:35:50.474072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8844-faa3-42f3-9c12-a150230cf17c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:50.475594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-08ec8844-faa3-42f3-9c12-a150230cf17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:50.627343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8844-faa3-42f3-9c12-a150230cf17c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:50.672890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:50.745100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d026-2bd3-4802-bd19-ae0bee647180 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:50.745463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d026-2bd3-4802-bd19-ae0bee647180 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:50.745831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d026-2bd3-4802-bd19-ae0bee647180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:50.755274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:50.755897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:50.756183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:50.756462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:50.758134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:50.818898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-aa61d026-2bd3-4802-bd19-ae0bee647180 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:50.820109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-aa61d026-2bd3-4802-bd19-ae0bee647180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:50.850410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:50.858778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:50.860393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f080a0-5256-4cfc-9c4f-205acf8a51ee service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:50.879276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 696/1397] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:50.909193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 702/1398] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:35:50.959562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d522e-7e9a-4403-b1e6-d304af91df2a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:50.959882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d522e-7e9a-4403-b1e6-d304af91df2a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:50.960165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d522e-7e9a-4403-b1e6-d304af91df2a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:50.961684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 697/1399] 10.222.0.46 () {54 vars in 943 bytes} [Fri Jul 29 04:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:50.968725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31614-da0d-4f2e-b18b-424f4e8e2114 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:50.969016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31614-da0d-4f2e-b18b-424f4e8e2114 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:50.969293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31614-da0d-4f2e-b18b-424f4e8e2114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:51.055028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-60d31614-da0d-4f2e-b18b-424f4e8e2114 None None] MFA Rules not processed for user `3cb7a5feda014624a86d87043526023d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:51.056186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-60d31614-da0d-4f2e-b18b-424f4e8e2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:51.170367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 703/1400] 10.222.0.46 () {58 vars in 1040 bytes} [Fri Jul 29 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:51.180182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d522e-7e9a-4403-b1e6-d304af91df2a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:51.181751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b54d522e-7e9a-4403-b1e6-d304af91df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:51.242508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:51.332143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d522e-7e9a-4403-b1e6-d304af91df2a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:51.438014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:51.438630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:51.438909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:51.439178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:51.440928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:51.470143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:51.523887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:51.525678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0da6a8-7403-4676-8b6e-23776cd0b8c3 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:51.533891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 698/1401] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:35:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:35:52.964855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f2ca-a2f0-4354-a3f2-6b13ba240806 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:52.965425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f2ca-a2f0-4354-a3f2-6b13ba240806 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:52.965425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f2ca-a2f0-4354-a3f2-6b13ba240806 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:52.966953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 704/1402] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:52.972553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2dcd2-3e69-4cbd-9e10-a1f5d0ffe8d2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:52.973011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2dcd2-3e69-4cbd-9e10-a1f5d0ffe8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:52.973290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2dcd2-3e69-4cbd-9e10-a1f5d0ffe8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:53.054110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3cc2dcd2-3e69-4cbd-9e10-a1f5d0ffe8d2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:53.055325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3cc2dcd2-3e69-4cbd-9e10-a1f5d0ffe8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:53.165654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 699/1403] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:35:53.211266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f2ca-a2f0-4354-a3f2-6b13ba240806 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:53.212797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1d84f2ca-a2f0-4354-a3f2-6b13ba240806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:53.215987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:53.381937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84f2ca-a2f0-4354-a3f2-6b13ba240806 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:53.465293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:53.515001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:53.517284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:53.518116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:53.519452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:53.522984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:53.626517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:53.628606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b8ce1-7e72-42b2-b841-b798820921a1 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:53.650232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 705/1404] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:35:55.719711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b0910-64db-48f4-8913-8defc57f624c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:55.720290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b0910-64db-48f4-8913-8defc57f624c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:55.720290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b0910-64db-48f4-8913-8defc57f624c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:55.723401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 700/1405] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:35:55.727724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8374-318a-4273-b155-b1d7d2006b31 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:55.728233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8374-318a-4273-b155-b1d7d2006b31 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:55.728348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8374-318a-4273-b155-b1d7d2006b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:55.807940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f39e8374-318a-4273-b155-b1d7d2006b31 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:35:55.809180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f39e8374-318a-4273-b155-b1d7d2006b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:55.861486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:55.999069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 706/1406] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:35:56.049051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b0910-64db-48f4-8913-8defc57f624c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:35:56.051423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-638b0910-64db-48f4-8913-8defc57f624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:56.081009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:56.221759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b0910-64db-48f4-8913-8defc57f624c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:35:56.325368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:35:56.345835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:35:56.346456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:35:56.346793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:35:56.347067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:35:56.348712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:35:56.446685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:35:56.448287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bb2b2-d97a-4cac-aa1a-27342a193b5f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:35:56.477846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 701/1407] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:05.996739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=26 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:06.466708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=52 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:13.567905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dccebd-ecf9-4c86-a149-094df43d5a9a None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:13.568485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dccebd-ecf9-4c86-a149-094df43d5a9a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:13.568485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dccebd-ecf9-4c86-a149-094df43d5a9a None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:13.569864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 707/1408] 10.222.0.46 () {54 vars in 918 bytes} [Fri Jul 29 04:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:36:13.575007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea4c25-b7bb-4c54-87ef-499d9b70cb96 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:13.575476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea4c25-b7bb-4c54-87ef-499d9b70cb96 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:13.575581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea4c25-b7bb-4c54-87ef-499d9b70cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:13.650763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7fea4c25-b7bb-4c54-87ef-499d9b70cb96 None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:13.651999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7fea4c25-b7bb-4c54-87ef-499d9b70cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:13.754985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 702/1409] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Jul 29 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:13.769251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3897a9-9a93-4b53-881b-8ca68c2807b2 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:13.769535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3897a9-9a93-4b53-881b-8ca68c2807b2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:13.769837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3897a9-9a93-4b53-881b-8ca68c2807b2 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:13.771170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 708/1410] 10.222.0.46 () {54 vars in 918 bytes} [Fri Jul 29 04:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:13.775691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42c26-4b34-4673-939d-5f9b34c40d4e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:13.775983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42c26-4b34-4673-939d-5f9b34c40d4e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:13.776262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42c26-4b34-4673-939d-5f9b34c40d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:13.846609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:13.850198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-afa42c26-4b34-4673-939d-5f9b34c40d4e None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:13.851907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afa42c26-4b34-4673-939d-5f9b34c40d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:13.972602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 703/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Jul 29 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:16.443924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002ba6-ede7-4c37-977b-86feba0d72e3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:16.444487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002ba6-ede7-4c37-977b-86feba0d72e3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:16.444487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002ba6-ede7-4c37-977b-86feba0d72e3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:16.445837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 709/1412] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:16.451031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a00854-671d-422b-99bd-0f97ee200b75 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:16.451454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a00854-671d-422b-99bd-0f97ee200b75 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:16.451556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a00854-671d-422b-99bd-0f97ee200b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:16.515951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79a00854-671d-422b-99bd-0f97ee200b75 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:16.517180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79a00854-671d-422b-99bd-0f97ee200b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:16.571475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:16.613397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 704/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:16.656189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002ba6-ede7-4c37-977b-86feba0d72e3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:16.657751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0c002ba6-ede7-4c37-977b-86feba0d72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:16.800865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002ba6-ede7-4c37-977b-86feba0d72e3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:16.872474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:16.916120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:16.916754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:16.917040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:16.917310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:16.918993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:17.008341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:17.009936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667a114-b317-47c4-b6a7-27590d2c80d3 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:17.028966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 710/1414] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:17.928572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800534-5f34-42e4-abf6-4304fe4298ec None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:17.929097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800534-5f34-42e4-abf6-4304fe4298ec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:17.929097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800534-5f34-42e4-abf6-4304fe4298ec None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:17.930429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 705/1415] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:17.935598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed879dc5-3aff-4789-ab70-683d56982e54 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:17.936024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed879dc5-3aff-4789-ab70-683d56982e54 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:17.936150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed879dc5-3aff-4789-ab70-683d56982e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:18.009760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ed879dc5-3aff-4789-ab70-683d56982e54 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:18.010953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ed879dc5-3aff-4789-ab70-683d56982e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:18.036735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:18.104320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 711/1416] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:18.253917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5800534-5f34-42e4-abf6-4304fe4298ec None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:18.255452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d5800534-5f34-42e4-abf6-4304fe4298ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:18.406946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5800534-5f34-42e4-abf6-4304fe4298ec None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:18.446352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:18.518206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:18.518751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:18.519781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:18.520065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:18.521731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:18.610285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:18.611877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db746b-1d31-4739-84a4-f7699eb2e709 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:18.629988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 706/1417] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:19.505921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c1276-0d14-47ed-a834-cbc5ef8d6c5e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:19.506358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c1276-0d14-47ed-a834-cbc5ef8d6c5e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:19.506481 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c1276-0d14-47ed-a834-cbc5ef8d6c5e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:19.507819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 712/1418] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:19.512659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67ab04-4517-41ee-8ff1-1c2fe8bd8cf8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:19.513070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67ab04-4517-41ee-8ff1-1c2fe8bd8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:19.513223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67ab04-4517-41ee-8ff1-1c2fe8bd8cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:19.568564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:19.591076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8b67ab04-4517-41ee-8ff1-1c2fe8bd8cf8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:19.592304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b67ab04-4517-41ee-8ff1-1c2fe8bd8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:19.696614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 707/1419] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:36:19.849689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c1276-0d14-47ed-a834-cbc5ef8d6c5e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:19.851171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bf3c1276-0d14-47ed-a834-cbc5ef8d6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:20.015315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c1276-0d14-47ed-a834-cbc5ef8d6c5e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:20.027518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:20.128108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:20.128673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:20.128957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:20.129232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:20.130883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:20.218661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:20.220234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4e74c-e0d3-48a1-bec4-d1907438b53e service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:20.249554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 713/1420] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:21.101504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23c86e-5078-4dc0-aef8-35b37f14c6ae None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:21.102105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23c86e-5078-4dc0-aef8-35b37f14c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:21.102105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23c86e-5078-4dc0-aef8-35b37f14c6ae None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:21.103418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 708/1421] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:21.108500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c455e88-26a1-40de-bcb7-34799203d522 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:21.109181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c455e88-26a1-40de-bcb7-34799203d522 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:21.109564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c455e88-26a1-40de-bcb7-34799203d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:21.136180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:21.191945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9c455e88-26a1-40de-bcb7-34799203d522 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:21.193085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9c455e88-26a1-40de-bcb7-34799203d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:21.286527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 714/1422] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:21.440424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23c86e-5078-4dc0-aef8-35b37f14c6ae None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:21.442615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a23c86e-5078-4dc0-aef8-35b37f14c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:21.550746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:21.586900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23c86e-5078-4dc0-aef8-35b37f14c6ae None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:21.695611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:21.696163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:21.696449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:21.696726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:21.698400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:21.772170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:21.785995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:21.787584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4132-1b46-40d4-aaea-f3e5245bdec6 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:21.805986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 709/1423] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:22.654378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac90ccb-b656-4cfd-9637-14fb89ac2f0f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:22.654948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac90ccb-b656-4cfd-9637-14fb89ac2f0f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:22.654948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac90ccb-b656-4cfd-9637-14fb89ac2f0f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:22.656332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 715/1424] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:22.661177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d881e-388a-4028-b52d-7ff68241d80a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:22.661640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d881e-388a-4028-b52d-7ff68241d80a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:22.661767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d881e-388a-4028-b52d-7ff68241d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:22.738588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fa3d881e-388a-4028-b52d-7ff68241d80a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:22.739798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fa3d881e-388a-4028-b52d-7ff68241d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:22.834562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 710/1425] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:36:22.984401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac90ccb-b656-4cfd-9637-14fb89ac2f0f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:22.986004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bac90ccb-b656-4cfd-9637-14fb89ac2f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:23.070696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:23.132793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac90ccb-b656-4cfd-9637-14fb89ac2f0f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:23.244271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:23.244891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:23.245172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:23.245450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:23.247109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:23.294099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:23.335606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:23.337186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2fc81-9cd9-414b-8ae8-f018b29cd755 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:23.354650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 716/1426] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:24.156912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008894-af88-40f7-aeb0-960a6bf1abcf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:24.157444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008894-af88-40f7-aeb0-960a6bf1abcf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:24.157444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008894-af88-40f7-aeb0-960a6bf1abcf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:24.158868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:24.164505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17017-728f-4583-ac3b-412df21ac4ac None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:24.164934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17017-728f-4583-ac3b-412df21ac4ac None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:24.165082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17017-728f-4583-ac3b-412df21ac4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:24.239766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4dc17017-728f-4583-ac3b-412df21ac4ac None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:24.241075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4dc17017-728f-4583-ac3b-412df21ac4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:24.346237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:24.493755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008894-af88-40f7-aeb0-960a6bf1abcf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:24.495194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6f008894-af88-40f7-aeb0-960a6bf1abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:24.543955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:24.640582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008894-af88-40f7-aeb0-960a6bf1abcf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:24.752596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:24.753134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:24.754032 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:24.754314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:24.755958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:24.762734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:24.844775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:24.846407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b8a0d-5708-443a-b1db-958ed82d9ca6 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:24.864695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 712/1429] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:25.683559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb500f-0022-4ef8-a727-97a48bfb22d2 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:25.684085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb500f-0022-4ef8-a727-97a48bfb22d2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:25.684201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb500f-0022-4ef8-a727-97a48bfb22d2 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:25.685497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:36:25.690448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cdb75-51a8-4ce7-a1fb-8bda09ec2e8e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:25.691248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cdb75-51a8-4ce7-a1fb-8bda09ec2e8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:25.691248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cdb75-51a8-4ce7-a1fb-8bda09ec2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:25.766319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-322cdb75-51a8-4ce7-a1fb-8bda09ec2e8e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:25.767526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-322cdb75-51a8-4ce7-a1fb-8bda09ec2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:25.834319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:25.863975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:26.031917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb500f-0022-4ef8-a727-97a48bfb22d2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:26.033441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f4eb500f-0022-4ef8-a727-97a48bfb22d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:26.052230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:26.179577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb500f-0022-4ef8-a727-97a48bfb22d2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:26.263730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:26.289970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:26.290519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:26.290795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:26.291064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:26.292665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:26.379435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:26.381024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1535d5-44d3-47af-b6f0-c7778c14b959 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:26.399145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 719/1432] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:27.210917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a992-b29c-4118-9bed-b7de502b4c99 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:27.211494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a992-b29c-4118-9bed-b7de502b4c99 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:27.211494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a992-b29c-4118-9bed-b7de502b4c99 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:27.212744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:27.217655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b879a-6454-4977-82cd-7ffec5b6f8b4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:27.218113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b879a-6454-4977-82cd-7ffec5b6f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:27.218224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b879a-6454-4977-82cd-7ffec5b6f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:27.291988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-654b879a-6454-4977-82cd-7ffec5b6f8b4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:27.293183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-654b879a-6454-4977-82cd-7ffec5b6f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:27.333426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:27.386637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:27.535100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a992-b29c-4118-9bed-b7de502b4c99 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:27.536657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2fe3a992-b29c-4118-9bed-b7de502b4c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:27.680546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a992-b29c-4118-9bed-b7de502b4c99 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:27.732801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:27.790366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:27.790907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:27.791184 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:27.791459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:27.793052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:27.880664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:27.882306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2cb7-6dd7-427d-853c-4071339579e4 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:27.899726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 715/1435] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:28.692328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523bf40-1c5c-4141-9a6d-bf37048b7ebb None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:28.692906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523bf40-1c5c-4141-9a6d-bf37048b7ebb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:28.692906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523bf40-1c5c-4141-9a6d-bf37048b7ebb None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:28.694267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:28.699227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb048-9e0b-40bc-b5a0-cd9455175b05 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:28.699666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb048-9e0b-40bc-b5a0-cd9455175b05 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:28.699791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb048-9e0b-40bc-b5a0-cd9455175b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:28.777449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-32dbb048-9e0b-40bc-b5a0-cd9455175b05 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:28.778712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32dbb048-9e0b-40bc-b5a0-cd9455175b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:28.780702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:28.875669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:29.028175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523bf40-1c5c-4141-9a6d-bf37048b7ebb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:29.029719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1523bf40-1c5c-4141-9a6d-bf37048b7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:29.172696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523bf40-1c5c-4141-9a6d-bf37048b7ebb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:29.199305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:29.287911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:29.288447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:29.288723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:29.288997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:29.290915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:29.380395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:29.382002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adaff0-a29b-4fea-b454-44bd2d59ac6d service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:29.399904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 722/1438] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:31.318740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60546204-fadb-4ef0-b2cf-bd98993db203 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:31.319306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60546204-fadb-4ef0-b2cf-bd98993db203 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:31.319428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60546204-fadb-4ef0-b2cf-bd98993db203 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:31.320744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:31.325905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f3da2-d07d-47d5-b74e-e1acb616b972 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:31.326377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f3da2-d07d-47d5-b74e-e1acb616b972 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:31.326480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f3da2-d07d-47d5-b74e-e1acb616b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:31.366942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:31.401659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3d9f3da2-d07d-47d5-b74e-e1acb616b972 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:31.403482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d9f3da2-d07d-47d5-b74e-e1acb616b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:31.517793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:31.556571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60546204-fadb-4ef0-b2cf-bd98993db203 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:31.558147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60546204-fadb-4ef0-b2cf-bd98993db203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:31.660633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60546204-fadb-4ef0-b2cf-bd98993db203 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:31.696076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:31.739946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:31.740561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:31.740845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:31.741118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:31.742791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:31.849300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:31.850776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0ba7a-47b7-4d7b-9286-ed425ce5c25c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:31.869965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 718/1441] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:34.028880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8d27-32eb-4836-9f6d-7a7a0a43f03b None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:34.029441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8d27-32eb-4836-9f6d-7a7a0a43f03b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:34.029441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8d27-32eb-4836-9f6d-7a7a0a43f03b None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:34.030840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:34.036557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3b7e-4dfe-4673-83f3-8a78ef2ce1df None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:34.036988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3b7e-4dfe-4673-83f3-8a78ef2ce1df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:34.037136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3b7e-4dfe-4673-83f3-8a78ef2ce1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:34.109448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-749f3b7e-4dfe-4673-83f3-8a78ef2ce1df None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:34.110617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-749f3b7e-4dfe-4673-83f3-8a78ef2ce1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:34.123742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:34.207652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:34.245401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8d27-32eb-4836-9f6d-7a7a0a43f03b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:34.247031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3fdb8d27-32eb-4836-9f6d-7a7a0a43f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:34.349857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8d27-32eb-4836-9f6d-7a7a0a43f03b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:34.361830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:34.428122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:34.428781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:34.429132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:34.429459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:34.431068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:34.537258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:34.538732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496bf4e-6c35-454b-ba0d-904914d2a3aa service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:34.556896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 725/1444] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:36.868421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8ff9-809a-4e1c-a688-96b783b8acac None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:36.868986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8ff9-809a-4e1c-a688-96b783b8acac None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:36.868986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8ff9-809a-4e1c-a688-96b783b8acac None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:36.870374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:36.875687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0443-176f-4dac-b50e-1131cbc4b88a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:36.876085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0443-176f-4dac-b50e-1131cbc4b88a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:36.876281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e0443-176f-4dac-b50e-1131cbc4b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:36.927462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:36.947393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-131e0443-176f-4dac-b50e-1131cbc4b88a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:36.948698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-131e0443-176f-4dac-b50e-1131cbc4b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:37.043007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:37.082363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af8ff9-809a-4e1c-a688-96b783b8acac None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:37.083923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c2af8ff9-809a-4e1c-a688-96b783b8acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:37.185201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af8ff9-809a-4e1c-a688-96b783b8acac None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:37.224455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:37.258010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:37.258617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:37.258896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:37.259168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:37.260771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:37.365833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:37.367273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6fcb8-adda-45e2-a52d-fba756e72975 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:37.384873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 721/1447] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:39.508654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4281e3-a552-4533-8b68-a59cc713b5f9 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:39.509278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4281e3-a552-4533-8b68-a59cc713b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:39.509384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4281e3-a552-4533-8b68-a59cc713b5f9 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:39.511989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:36:39.517568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a000a-81c9-46b6-9fba-f9ce9f8a0afe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:39.518034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a000a-81c9-46b6-9fba-f9ce9f8a0afe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:39.518136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a000a-81c9-46b6-9fba-f9ce9f8a0afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:39.585803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-450a000a-81c9-46b6-9fba-f9ce9f8a0afe None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:39.587022 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-450a000a-81c9-46b6-9fba-f9ce9f8a0afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:39.606958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:39.683522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:36:39.722357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4281e3-a552-4533-8b68-a59cc713b5f9 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:39.723867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5f4281e3-a552-4533-8b68-a59cc713b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:39.826291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4281e3-a552-4533-8b68-a59cc713b5f9 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:39.845624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:39.899176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:39.899794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:39.900067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:39.900335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:39.901977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:40.010260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:40.011682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f903ec-43e6-4184-b569-b3e59eb0133d service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:40.030390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 728/1450] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:42.163386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30f67-190a-474b-b4fa-9c2314669cf4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:42.163916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30f67-190a-474b-b4fa-9c2314669cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:42.164009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe30f67-190a-474b-b4fa-9c2314669cf4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:42.165635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:42.170727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fd09e-9e62-46eb-b84d-fb29ff6f29a5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:42.171171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fd09e-9e62-46eb-b84d-fb29ff6f29a5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:42.171268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fd09e-9e62-46eb-b84d-fb29ff6f29a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:42.233189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:42.236076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bb8fd09e-9e62-46eb-b84d-fb29ff6f29a5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:42.237884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bb8fd09e-9e62-46eb-b84d-fb29ff6f29a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:42.335118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:42.373353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe30f67-190a-474b-b4fa-9c2314669cf4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:42.374917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ebe30f67-190a-474b-b4fa-9c2314669cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:42.477624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe30f67-190a-474b-b4fa-9c2314669cf4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:42.525156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:42.550225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:42.551483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:42.551772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:42.552055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:42.553697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:42.662720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:42.664154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81754830-b08c-41fc-90f9-56843c20f293 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:42.683355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 724/1453] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:44.720038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a27c-e16c-4afe-b8fb-ceccec11a6f2 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:44.720725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a27c-e16c-4afe-b8fb-ceccec11a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:44.720725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a27c-e16c-4afe-b8fb-ceccec11a6f2 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:44.722152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:44.728514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67708a0-318f-4ea5-b893-87d398a534a3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:44.728959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67708a0-318f-4ea5-b893-87d398a534a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:44.729122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67708a0-318f-4ea5-b893-87d398a534a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:44.797340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b67708a0-318f-4ea5-b893-87d398a534a3 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:44.799123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b67708a0-318f-4ea5-b893-87d398a534a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:44.839702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:44.910618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:44.949382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a27c-e16c-4afe-b8fb-ceccec11a6f2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:44.950957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7cf8a27c-e16c-4afe-b8fb-ceccec11a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:45.052644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a27c-e16c-4afe-b8fb-ceccec11a6f2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:45.080248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:45.133558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:45.134221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:45.134497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:45.134770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:45.136555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:45.244895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:45.246362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccbef4-bfac-4ad4-81de-804a8033aa8f service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:45.265017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 731/1456] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:47.308052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807871f5-1053-4ec0-9592-4e9695ee2822 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:47.308609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807871f5-1053-4ec0-9592-4e9695ee2822 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:47.308730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807871f5-1053-4ec0-9592-4e9695ee2822 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:47.310057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:47.315336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064b9a-1e79-4102-899e-ad346dd0bed7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:47.315781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064b9a-1e79-4102-899e-ad346dd0bed7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:47.315885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064b9a-1e79-4102-899e-ad346dd0bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:47.380700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7b064b9a-1e79-4102-899e-ad346dd0bed7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:47.381990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7b064b9a-1e79-4102-899e-ad346dd0bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:47.390707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:47.479545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:47.517578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807871f5-1053-4ec0-9592-4e9695ee2822 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:47.519403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-807871f5-1053-4ec0-9592-4e9695ee2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:47.623258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807871f5-1053-4ec0-9592-4e9695ee2822 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:47.680773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:47.699513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:47.700132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:47.700416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:47.700694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:47.702355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:47.809737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:47.811171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83ebd8-2250-497e-9302-175f4ad8b416 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:47.828912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 727/1459] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:49.870260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880622-a11b-487a-b1ca-a3373b4c0bab None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:49.870789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880622-a11b-487a-b1ca-a3373b4c0bab None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:49.870789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5880622-a11b-487a-b1ca-a3373b4c0bab None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:49.872146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:49.877214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845bbc1-dfee-4c08-8231-aa20f5b5ae24 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:49.877712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845bbc1-dfee-4c08-8231-aa20f5b5ae24 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:49.877824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845bbc1-dfee-4c08-8231-aa20f5b5ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:49.944346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5845bbc1-dfee-4c08-8231-aa20f5b5ae24 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:49.945565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5845bbc1-dfee-4c08-8231-aa20f5b5ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:49.983596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:50.041520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:50.079097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5880622-a11b-487a-b1ca-a3373b4c0bab None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:50.080910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a5880622-a11b-487a-b1ca-a3373b4c0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:50.183329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5880622-a11b-487a-b1ca-a3373b4c0bab None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:50.220038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:50.255922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:50.256536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:50.256819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:50.257093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:50.258757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:50.364653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:50.366113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f597e8-c795-43eb-94c5-e8de3a7ce789 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:50.384101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 734/1462] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:52.401959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84aaf-ef63-4604-9fb5-625cb20b4ed4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:52.402526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84aaf-ef63-4604-9fb5-625cb20b4ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:52.402526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84aaf-ef63-4604-9fb5-625cb20b4ed4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:52.403862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:52.409055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c806ac-cffb-4581-b91b-ec955e86876f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:52.409524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c806ac-cffb-4581-b91b-ec955e86876f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:52.409662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c806ac-cffb-4581-b91b-ec955e86876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:52.476403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a4c806ac-cffb-4581-b91b-ec955e86876f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:52.477647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a4c806ac-cffb-4581-b91b-ec955e86876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:52.495354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:52.573528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:52.610500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c84aaf-ef63-4604-9fb5-625cb20b4ed4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:52.612063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c5c84aaf-ef63-4604-9fb5-625cb20b4ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:52.715445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c84aaf-ef63-4604-9fb5-625cb20b4ed4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:52.899242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:52.906705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:52.907312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:52.907596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:52.907873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:52.909489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:53.016692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:53.018167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd2f9-1a6b-4108-a6ae-eb62c413a35c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:53.036305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 730/1465] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:36:55.018980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0993b40-1166-486b-9ec7-7ef2750a7985 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:55.019535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0993b40-1166-486b-9ec7-7ef2750a7985 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:55.019535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0993b40-1166-486b-9ec7-7ef2750a7985 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:55.020913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:55.025986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d53e2c-c735-416f-9057-4abb30413345 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:55.026426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d53e2c-c735-416f-9057-4abb30413345 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:55.026531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d53e2c-c735-416f-9057-4abb30413345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:55.091604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-00d53e2c-c735-416f-9057-4abb30413345 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:55.092790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00d53e2c-c735-416f-9057-4abb30413345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:55.139606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:55.186840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:55.240068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd91d24-19ef-4040-8c4c-a9d3076864b2 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:55.240493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd91d24-19ef-4040-8c4c-a9d3076864b2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:55.240779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd91d24-19ef-4040-8c4c-a9d3076864b2 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:55.242176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 737/1468] 10.222.0.46 () {54 vars in 965 bytes} [Fri Jul 29 04:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:36:55.247975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6333d-943c-4ff7-ba1e-8f65ad7be7c1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:55.248266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6333d-943c-4ff7-ba1e-8f65ad7be7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:55.248543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6333d-943c-4ff7-ba1e-8f65ad7be7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:55.323265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eeb6333d-943c-4ff7-ba1e-8f65ad7be7c1 None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:36:55.324469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eeb6333d-943c-4ff7-ba1e-8f65ad7be7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:55.403817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 732/1469] 10.222.0.46 () {58 vars in 1062 bytes} [Fri Jul 29 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:36:55.413204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd91d24-19ef-4040-8c4c-a9d3076864b2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:36:55.414776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-acd91d24-19ef-4040-8c4c-a9d3076864b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:55.517056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd91d24-19ef-4040-8c4c-a9d3076864b2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:36:55.576962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:36:55.602344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:36:55.602963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:36:55.603243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:36:55.603515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:36:55.605124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:36:55.713485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:36:55.714953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500390d-a284-41e6-9d21-52f52b812d17 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:36:55.732902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 738/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:37:05.401979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:05.730708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=66 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:15.750424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a6bf-d560-4811-9845-93f02f56e4ba None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:15.750980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a6bf-d560-4811-9845-93f02f56e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:15.750980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a6bf-d560-4811-9845-93f02f56e4ba None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:15.752316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 733/1471] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:15.758260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01b99-276c-446f-a185-5ad93e081939 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:15.758687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01b99-276c-446f-a185-5ad93e081939 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:15.758917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01b99-276c-446f-a185-5ad93e081939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:15.824751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c1c01b99-276c-446f-a185-5ad93e081939 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:15.825996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c1c01b99-276c-446f-a185-5ad93e081939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:15.928742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 739/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:16.012030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595998c-a036-4ee3-b71c-17304ec8f503 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:16.012315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595998c-a036-4ee3-b71c-17304ec8f503 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:16.012588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595998c-a036-4ee3-b71c-17304ec8f503 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:16.013931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 734/1473] 10.222.0.46 () {54 vars in 966 bytes} [Fri Jul 29 04:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:16.018727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d13c5-4f04-4f42-b255-39c9aac8809f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:16.019014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d13c5-4f04-4f42-b255-39c9aac8809f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:16.019287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d13c5-4f04-4f42-b255-39c9aac8809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:16.092608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-647d13c5-4f04-4f42-b255-39c9aac8809f None None] MFA Rules not processed for user `0dddbf2245fc4a71b91102e821f177ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:16.093827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-647d13c5-4f04-4f42-b255-39c9aac8809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:16.114711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:16.173665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 740/1474] 10.222.0.46 () {58 vars in 1063 bytes} [Fri Jul 29 04:37:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:16.184077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595998c-a036-4ee3-b71c-17304ec8f503 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:16.185785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2595998c-a036-4ee3-b71c-17304ec8f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:16.286564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595998c-a036-4ee3-b71c-17304ec8f503 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:16.356824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:16.357430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:16.357736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:16.358009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:16.359599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:16.412161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:16.465857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:16.467280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06889a8c-4a95-495b-ae09-e25d9694103b service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:16.485678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 735/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:37:18.693298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1a9c-0802-468d-8164-d12850a56c2d None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:18.693937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1a9c-0802-468d-8164-d12850a56c2d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:18.693937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1a9c-0802-468d-8164-d12850a56c2d None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:18.695387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 741/1476] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:18.700508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7667-5c68-4c90-921b-ef18819b989b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:18.700937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7667-5c68-4c90-921b-ef18819b989b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:18.701067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7667-5c68-4c90-921b-ef18819b989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:18.765910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-67af7667-5c68-4c90-921b-ef18819b989b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:18.767112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-67af7667-5c68-4c90-921b-ef18819b989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:18.861614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 736/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:18.884457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1a9c-0802-468d-8164-d12850a56c2d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:18.886063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-61bf1a9c-0802-468d-8164-d12850a56c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:19.009804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1a9c-0802-468d-8164-d12850a56c2d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:19.058131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:19.104034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:19.104652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:19.104935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:19.105210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:19.105941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:19.107667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:37:19.107667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:37:19.107667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:37:19.108807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35026754-0fd8-4f74-8f9d-62c44e77b2a2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:19.127379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 742/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 29 04:37:18 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:37:21.163571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521910f8-b73e-4124-aace-5adc861855a3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:21.164127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521910f8-b73e-4124-aace-5adc861855a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:21.164127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521910f8-b73e-4124-aace-5adc861855a3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:21.165441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 737/1479] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:21.171018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c7ce-12e9-4ea4-afb7-c653ecad185c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:21.171454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c7ce-12e9-4ea4-afb7-c653ecad185c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:21.171558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c7ce-12e9-4ea4-afb7-c653ecad185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:21.235159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0683c7ce-12e9-4ea4-afb7-c653ecad185c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:21.236355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0683c7ce-12e9-4ea4-afb7-c653ecad185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:21.330765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 743/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:21.373519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521910f8-b73e-4124-aace-5adc861855a3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:21.375097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-521910f8-b73e-4124-aace-5adc861855a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:21.385355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:21.517554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521910f8-b73e-4124-aace-5adc861855a3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:21.595714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:21.628633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:21.629238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:21.629517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:21.629854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:21.631461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:21.719016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:21.720589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3daa3c-d5b1-40e9-bf9e-15325d316a36 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:21.741227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 738/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:37:23.906873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de502f-7a19-4e2b-8d51-6d2c5b587300 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:23.907414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de502f-7a19-4e2b-8d51-6d2c5b587300 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:23.907522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de502f-7a19-4e2b-8d51-6d2c5b587300 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:23.908908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 744/1482] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:23.914591 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c27d-4c5d-4ce5-a7ab-dae15a16dacd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:23.915005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c27d-4c5d-4ce5-a7ab-dae15a16dacd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:23.915145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c27d-4c5d-4ce5-a7ab-dae15a16dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:23.983197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-88b8c27d-4c5d-4ce5-a7ab-dae15a16dacd None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:23.984392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-88b8c27d-4c5d-4ce5-a7ab-dae15a16dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:24.029011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:24.079428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 739/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:24.115958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de502f-7a19-4e2b-8d51-6d2c5b587300 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:24.117478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-22de502f-7a19-4e2b-8d51-6d2c5b587300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:24.140777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:24.219770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de502f-7a19-4e2b-8d51-6d2c5b587300 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:24.300102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:24.300723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:24.301083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:24.302067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:24.303886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:24.377214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:24.411511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:24.413024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714d64-f3e6-4db2-b6bb-237acb9feeb0 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:24.431665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 745/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:37:26.515980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0a3f-e617-416c-b0f2-bbc709ec0733 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:26.516403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0a3f-e617-416c-b0f2-bbc709ec0733 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:26.516520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0a3f-e617-416c-b0f2-bbc709ec0733 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:26.517930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 740/1485] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:26.523833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6305c-28c9-4bbc-8d2f-822fdd398303 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:26.524251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6305c-28c9-4bbc-8d2f-822fdd398303 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:26.524440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6305c-28c9-4bbc-8d2f-822fdd398303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:26.595388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c4e6305c-28c9-4bbc-8d2f-822fdd398303 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:26.596606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c4e6305c-28c9-4bbc-8d2f-822fdd398303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:26.690607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 746/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:26.730265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0a3f-e617-416c-b0f2-bbc709ec0733 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:26.731789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7c6b0a3f-e617-416c-b0f2-bbc709ec0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:26.839639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0a3f-e617-416c-b0f2-bbc709ec0733 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:26.922661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:26.924988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:26.926013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:26.926311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:26.927678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:26.929406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:27.038809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:27.040298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3cf0f-b6e9-4297-a9b2-2eadf2f5ebc8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:27.058279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 741/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:37:29.250402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336163d6-37ce-48f0-9ef2-38fbc39fd1cd None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:29.251018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336163d6-37ce-48f0-9ef2-38fbc39fd1cd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:29.251018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336163d6-37ce-48f0-9ef2-38fbc39fd1cd None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:29.252367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 747/1488] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:37:29.258243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf97f-4904-4222-85d0-9d8667e95658 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:29.258674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf97f-4904-4222-85d0-9d8667e95658 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:29.258782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf97f-4904-4222-85d0-9d8667e95658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:29.323307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1abbf97f-4904-4222-85d0-9d8667e95658 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:29.324512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1abbf97f-4904-4222-85d0-9d8667e95658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:29.375689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:29.419872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 742/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:29.460110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336163d6-37ce-48f0-9ef2-38fbc39fd1cd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:29.461705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-336163d6-37ce-48f0-9ef2-38fbc39fd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:29.496973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:29.565077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336163d6-37ce-48f0-9ef2-38fbc39fd1cd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:29.638760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:29.639378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:29.639667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:29.639946 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:29.641576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:29.722142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:29.751182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:29.752599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eb61a-2ebd-42b5-91ea-cc82adebab8a service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:29.769926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 748/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:37:31.991873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5a53-cc0b-42d9-a63b-954c5ab3d819 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:31.992430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5a53-cc0b-42d9-a63b-954c5ab3d819 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:31.992430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad5a53-cc0b-42d9-a63b-954c5ab3d819 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:31.993809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 743/1491] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 29 04:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:37:31.999267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575b57f-fb6c-46b5-9a12-8a7ad20ca81e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:31.999672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575b57f-fb6c-46b5-9a12-8a7ad20ca81e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:32.000141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575b57f-fb6c-46b5-9a12-8a7ad20ca81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:32.065723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0575b57f-fb6c-46b5-9a12-8a7ad20ca81e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:37:32.066982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0575b57f-fb6c-46b5-9a12-8a7ad20ca81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:32.162575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 749/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 29 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:37:32.202269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5a53-cc0b-42d9-a63b-954c5ab3d819 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:37:32.203808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-33ad5a53-cc0b-42d9-a63b-954c5ab3d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:32.306844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad5a53-cc0b-42d9-a63b-954c5ab3d819 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:37:32.380453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:37:32.381070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:37:32.381351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:37:32.381717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:37:32.383342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:37:32.393264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:32.491031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:37:32.492459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21199b3e-2977-4382-a26c-f3bf08009ff5 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:37:32.510579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 744/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:37:42.160721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=82 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:37:42.508275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=50 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:13.677674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:13.678226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:13.678226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:13.750956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:39:13.752150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:13.846717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 750/1494] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:39:13.854760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:13.855230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:13.855230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:13.929334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:39:13.930564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:14.024162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 745/1495] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:39:14.028772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:14.030065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:14.041383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eb1f6-ad23-43a3-bbe8-e3ecf84a3b13 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:14.101528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:14.139755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:14.140290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:14.140569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:14.141276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:14.141527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:39:14.141865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:14.142872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:14.142872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:39:14.142872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:39:14.143996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:14.155469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 751/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:39:14.163737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:14.172991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6000ce3-f245-44b1-88b2-08097db59583 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:14.233589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:14.267385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:14.268000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:14.268284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:14.268559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:14.269227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:14.271479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:14.271479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:39:14.271479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:39:14.272677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:14.327089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 746/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:39:14 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:39:14.331207 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:14.332757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:14.366796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4354703-ef40-49ce-93b7-a7ae53f2cce1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:14.460923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:14.461446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:14.461766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:14.462043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:14.462701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:14.463698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:14.463698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:39:14.463698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:39:14.464927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:14.506327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 752/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:39:14 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:39:14.510434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:14.511934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:14.576102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64313b-b937-40ea-83d6-9f25e0e7d19f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:14.658168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:14.669215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:14.669856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:14.670133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:14.670400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:14.671079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:14.672333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:14.672333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:39:14.672333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:39:14.673214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:14.685149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 747/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:39:14.689404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:14.691103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:14.703289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a879f-1213-4649-b612-7b64c98bd4a3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:14.729646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:14.798686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:14.799309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:14.799592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:14.799866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:14.800560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:14.801578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:14.801578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:39:14.801578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:39:14.802538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb499a8-88d7-45ca-8f41-ffba4a37798c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:14.815732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 753/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:39:14.820526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:14.822124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:14.855324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d620181-a1ac-45cc-a203-85103ef353f3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:14.948851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:14.949518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:14.949834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:14.950104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] PATH_INFO: `/v3/projects/d3a45721411c4a4a8ef767491329c80b/users/6d412fc16d444c12b150bc3dc82d2da8/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:14.972001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a45721411c4a4a8ef767491329c80b, user_id=6d412fc16d444c12b150bc3dc82d2da8, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:14.973028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:14.973028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:39:14.973028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:39:14.975669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db20f-f7e0-4f38-830d-583e85d222a9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:14.999191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 748/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:39:14 2022] PUT /identity/v3/projects/d3a45721411c4a4a8ef767491329c80b/users/6d412fc16d444c12b150bc3dc82d2da8/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:39:15.011189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ea94-358b-4359-8326-0f8b2e498518 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:15.011486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ea94-358b-4359-8326-0f8b2e498518 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:15.011771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ea94-358b-4359-8326-0f8b2e498518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:15.070069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b779ea94-358b-4359-8326-0f8b2e498518 None None] MFA Rules not processed for user `6d412fc16d444c12b150bc3dc82d2da8`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:39:15.071291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b779ea94-358b-4359-8326-0f8b2e498518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:15.148149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 754/1502] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:39:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:39:15.161034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec49d-f741-42d6-a142-722350da5082 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:15.161980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec49d-f741-42d6-a142-722350da5082 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:15.162270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec49d-f741-42d6-a142-722350da5082 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:15.163635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 749/1503] 10.222.0.46 () {54 vars in 964 bytes} [Fri Jul 29 04:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:39:15.168229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da9be-1c1a-4189-ba38-b5b76a133269 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:15.168519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da9be-1c1a-4189-ba38-b5b76a133269 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:15.168799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da9be-1c1a-4189-ba38-b5b76a133269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:15.199266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:15.244106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ef3da9be-1c1a-4189-ba38-b5b76a133269 None None] MFA Rules not processed for user `18adc9c4a6514351ba0d9df140578a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:39:15.245307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ef3da9be-1c1a-4189-ba38-b5b76a133269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:15.319082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 755/1504] 10.222.0.46 () {58 vars in 1061 bytes} [Fri Jul 29 04:39:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:39:15.326715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec49d-f741-42d6-a142-722350da5082 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:15.328219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b91ec49d-f741-42d6-a142-722350da5082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:15.377648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:15.433572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec49d-f741-42d6-a142-722350da5082 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:15.505907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:15.506528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:15.506812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:15.507088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:15.508717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:15.606580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:15.608015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:15.611580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:15.627095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 750/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:39:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:39:15.672769 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1981-77f1-44b8-9639-c20bba9972e8 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:15.673060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1981-77f1-44b8-9639-c20bba9972e8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:15.673341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a1981-77f1-44b8-9639-c20bba9972e8 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:15.674636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 756/1506] 10.222.0.46 () {52 vars in 830 bytes} [Fri Jul 29 04:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:39:15.678782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:15.679975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:15.780393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6664e6-5a8b-4b29-a4d7-e68a5bb5e610 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:15.874551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:15.875213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:15.875375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:15.875650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] PATH_INFO: `/v3/users/6d412fc16d444c12b150bc3dc82d2da8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:15.888069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d412fc16d444c12b150bc3dc82d2da8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:15.889099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:15.889099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:39:15.889099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:39:15.890365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:15.900604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:15.953456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d412fc16d444c12b150bc3dc82d2da8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:15.966193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d412fc16d444c12b150bc3dc82d2da8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:15.966641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d412fc16d444c12b150bc3dc82d2da8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:15.967169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d412fc16d444c12b150bc3dc82d2da8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:15.985360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d412fc16d444c12b150bc3dc82d2da8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:16.000489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 751/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:39:15 2022] DELETE /identity/v3/users/6d412fc16d444c12b150bc3dc82d2da8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:39:16.005096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:16.005570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:16.005706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:16.062065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:39:16.063304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:16.138044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:16.151898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 757/1508] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:39:16.161322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:16.162572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:16.261520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563bc98-4d5f-4457-9a2d-d6799547d8a3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:16.313704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:16.335090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:16.335702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:16.335981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:16.336253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:16.337884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:16.441900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:16.443871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c969892-a124-4ea3-b386-e0a7fcc0948f service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:16.463418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 752/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:39:16.805919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:39:16.807182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:39:16.819416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20a020-e520-4d9c-862b-44b4ec751a0e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:39:16.919472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:39:16.920126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:39:16.920409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:39:16.920687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] PATH_INFO: `/v3/projects/d3a45721411c4a4a8ef767491329c80b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:39:16.931068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a45721411c4a4a8ef767491329c80b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:39:16.932098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:16.932098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:39:16.932098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:39:16.933303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:39:16.990478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a45721411c4a4a8ef767491329c80b', 'request_id': 'req-6a20c7c6-28ef-425f-9356-feb1511aafef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:17.003420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a45721411c4a4a8ef767491329c80b', 'request_id': 'req-6a20c7c6-28ef-425f-9356-feb1511aafef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:17.011166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a45721411c4a4a8ef767491329c80b', 'request_id': 'req-6a20c7c6-28ef-425f-9356-feb1511aafef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:17.039619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] The token cache is being invalidate because project d3a45721411c4a4a8ef767491329c80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:39:17.039908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:17.040432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6a20c7c6-28ef-425f-9356-feb1511aafef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:39:17.041786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 758/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:39:16 2022] DELETE /identity/v3/projects/d3a45721411c4a4a8ef767491329c80b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:39:26.461200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=62 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:27.037614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:02.391294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fd982-fa01-4088-80aa-70949861402c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:02.391879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fd982-fa01-4088-80aa-70949861402c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:02.391879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fd982-fa01-4088-80aa-70949861402c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:02.393228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:41:02.398009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24fb9-452a-43bd-b4a2-54e20a57136d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:02.398466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24fb9-452a-43bd-b4a2-54e20a57136d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:02.398600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24fb9-452a-43bd-b4a2-54e20a57136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:02.478755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-25b24fb9-452a-43bd-b4a2-54e20a57136d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:02.479971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-25b24fb9-452a-43bd-b4a2-54e20a57136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:02.582848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:02.738740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fd982-fa01-4088-80aa-70949861402c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:02.742388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1a3fd982-fa01-4088-80aa-70949861402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:02.859626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fd982-fa01-4088-80aa-70949861402c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:02.865575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f1381-bf87-4404-b262-6880a227d2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:02.866216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f1381-bf87-4404-b262-6880a227d2e1 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:02.866502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f1381-bf87-4404-b262-6880a227d2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:02.866776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f1381-bf87-4404-b262-6880a227d2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:02.874755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f1381-bf87-4404-b262-6880a227d2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:02.876317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f1381-bf87-4404-b262-6880a227d2e1 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:02.885569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 754/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:03.737936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790416b-81f9-4d6c-b98c-cb3d6b81f736 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:03.738431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790416b-81f9-4d6c-b98c-cb3d6b81f736 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:03.738533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790416b-81f9-4d6c-b98c-cb3d6b81f736 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:03.739862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:03.744644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf000e3-191f-4d84-999f-52208263c2f9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:03.745081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf000e3-191f-4d84-999f-52208263c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:03.745224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf000e3-191f-4d84-999f-52208263c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:03.764030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8bf000e3-191f-4d84-999f-52208263c2f9 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:03.765217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8bf000e3-191f-4d84-999f-52208263c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:03.773475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:41:03.924412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790416b-81f9-4d6c-b98c-cb3d6b81f736 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:03.939030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790416b-81f9-4d6c-b98c-cb3d6b81f736 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:03.944316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4937a11-c0f0-4d25-8cc7-f4241f72dc64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:03.944919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937a11-c0f0-4d25-8cc7-f4241f72dc64 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:03.945199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937a11-c0f0-4d25-8cc7-f4241f72dc64 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:03.945469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937a11-c0f0-4d25-8cc7-f4241f72dc64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:03.953546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4937a11-c0f0-4d25-8cc7-f4241f72dc64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:03.955144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4937a11-c0f0-4d25-8cc7-f4241f72dc64 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:03.964830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 761/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:04.536270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf922fe-87ba-4808-aec6-8872d3667798 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:04.536555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf922fe-87ba-4808-aec6-8872d3667798 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:04.536829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf922fe-87ba-4808-aec6-8872d3667798 None None] PATH_INFO: `/v3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:04.538128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 756/1517] 10.222.0.17 () {54 vars in 925 bytes} [Fri Jul 29 04:41:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:41:04.545076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362b36-964f-4389-ae75-513f25902872 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:04.545368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362b36-964f-4389-ae75-513f25902872 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:04.545672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f362b36-964f-4389-ae75-513f25902872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:04.604442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1f362b36-964f-4389-ae75-513f25902872 None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:04.605673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1f362b36-964f-4389-ae75-513f25902872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:04.622409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:04.678148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 762/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Jul 29 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:13.759290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=56 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:13.883475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcca41-dff8-4d7b-b127-5230d74a904e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:13.883769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcca41-dff8-4d7b-b127-5230d74a904e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:13.884050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcca41-dff8-4d7b-b127-5230d74a904e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:13.885427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 757/1519] 10.222.0.46 () {54 vars in 961 bytes} [Fri Jul 29 04:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:13.890289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11406b68-0bd0-45a9-b1e4-4cdf1b63f082 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:13.890752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11406b68-0bd0-45a9-b1e4-4cdf1b63f082 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:13.890849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11406b68-0bd0-45a9-b1e4-4cdf1b63f082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:13.910429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-11406b68-0bd0-45a9-b1e4-4cdf1b63f082 None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:13.911620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-11406b68-0bd0-45a9-b1e4-4cdf1b63f082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:13.920035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 763/1520] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Jul 29 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:13.929176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcca41-dff8-4d7b-b127-5230d74a904e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:13.942769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcca41-dff8-4d7b-b127-5230d74a904e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:13.947705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46dfba-da53-4125-94ff-e91f99338f0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:13.948304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46dfba-da53-4125-94ff-e91f99338f0e service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:13.948582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46dfba-da53-4125-94ff-e91f99338f0e service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:13.948853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46dfba-da53-4125-94ff-e91f99338f0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:13.957132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46dfba-da53-4125-94ff-e91f99338f0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:13.958726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46dfba-da53-4125-94ff-e91f99338f0e service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:13.968157 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 758/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:15.187638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b93595-6f11-46cd-9713-6bf210e9c562 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:15.188163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b93595-6f11-46cd-9713-6bf210e9c562 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:15.188163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b93595-6f11-46cd-9713-6bf210e9c562 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:15.189454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:15.194178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646537-2c12-46a2-8ec4-b42c956af814 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:15.194563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646537-2c12-46a2-8ec4-b42c956af814 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:15.194762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646537-2c12-46a2-8ec4-b42c956af814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:15.214065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-69646537-2c12-46a2-8ec4-b42c956af814 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:15.215247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69646537-2c12-46a2-8ec4-b42c956af814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:15.223573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:15.376486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b93595-6f11-46cd-9713-6bf210e9c562 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:15.392023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b93595-6f11-46cd-9713-6bf210e9c562 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:15.398177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef14da-6796-42f3-b809-954b4c85b430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:15.398809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef14da-6796-42f3-b809-954b4c85b430 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:15.399090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef14da-6796-42f3-b809-954b4c85b430 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:15.399364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef14da-6796-42f3-b809-954b4c85b430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:15.410275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef14da-6796-42f3-b809-954b4c85b430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:15.411910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef14da-6796-42f3-b809-954b4c85b430 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:15.421855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 765/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:16.274577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40e87c-8831-4fb1-aa36-3372295eaa78 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:16.275143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40e87c-8831-4fb1-aa36-3372295eaa78 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:16.275143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40e87c-8831-4fb1-aa36-3372295eaa78 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:16.276525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 29 04:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:16.281424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09e60-9764-4e3e-965d-18f3e1cc808a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:16.281870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09e60-9764-4e3e-965d-18f3e1cc808a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:16.282018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09e60-9764-4e3e-965d-18f3e1cc808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:16.301264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-12c09e60-9764-4e3e-965d-18f3e1cc808a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:16.302502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-12c09e60-9764-4e3e-965d-18f3e1cc808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:16.310604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 29 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:41:16.460422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40e87c-8831-4fb1-aa36-3372295eaa78 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:16.474769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40e87c-8831-4fb1-aa36-3372295eaa78 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:16.480314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890c22-bf05-477a-8dad-ff086b11c6e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:16.480908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890c22-bf05-477a-8dad-ff086b11c6e0 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:16.481213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890c22-bf05-477a-8dad-ff086b11c6e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:16.481485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890c22-bf05-477a-8dad-ff086b11c6e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:16.490089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890c22-bf05-477a-8dad-ff086b11c6e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:16.491656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890c22-bf05-477a-8dad-ff086b11c6e0 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:16.500787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 761/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:41:20.383271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e589c-e225-4165-b436-e7fbf9c8d98c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:20.383825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e589c-e225-4165-b436-e7fbf9c8d98c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:20.383825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e589c-e225-4165-b436-e7fbf9c8d98c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:20.385281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:20.390357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f792b-a4ce-47dd-a614-1c5b856bbbc6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:20.390763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f792b-a4ce-47dd-a614-1c5b856bbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:20.390914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f792b-a4ce-47dd-a614-1c5b856bbbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:20.410768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-159f792b-a4ce-47dd-a614-1c5b856bbbc6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:20.411955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-159f792b-a4ce-47dd-a614-1c5b856bbbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:20.419705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:41:20.492201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e589c-e225-4165-b436-e7fbf9c8d98c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:20.493956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-417e589c-e225-4165-b436-e7fbf9c8d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:20.571358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e589c-e225-4165-b436-e7fbf9c8d98c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:20.575209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979bc94-fe3b-4ef7-97d5-a1bf1e718a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:20.575798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979bc94-fe3b-4ef7-97d5-a1bf1e718a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:20.576081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979bc94-fe3b-4ef7-97d5-a1bf1e718a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:20.576357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979bc94-fe3b-4ef7-97d5-a1bf1e718a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:20.585364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979bc94-fe3b-4ef7-97d5-a1bf1e718a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:20.586831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979bc94-fe3b-4ef7-97d5-a1bf1e718a3c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:20.596129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 768/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:22.575279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2b0c-c0bd-411a-b9c0-887456bf3989 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:22.575872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2b0c-c0bd-411a-b9c0-887456bf3989 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:22.575872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b2b0c-c0bd-411a-b9c0-887456bf3989 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:22.577202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:22.582294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86da4f-e14d-4a0d-a304-7b28485d0b1d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:22.582724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86da4f-e14d-4a0d-a304-7b28485d0b1d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:22.582879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86da4f-e14d-4a0d-a304-7b28485d0b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:22.603450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ac86da4f-e14d-4a0d-a304-7b28485d0b1d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:22.604639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ac86da4f-e14d-4a0d-a304-7b28485d0b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:22.612381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:22.648371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b2b0c-c0bd-411a-b9c0-887456bf3989 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:22.658978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b2b0c-c0bd-411a-b9c0-887456bf3989 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:22.662954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4be5a-dc26-488d-9629-9d603f40e7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:22.663553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4be5a-dc26-488d-9629-9d603f40e7db service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:22.663828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4be5a-dc26-488d-9629-9d603f40e7db service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:22.664108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4be5a-dc26-488d-9629-9d603f40e7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:22.672804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4be5a-dc26-488d-9629-9d603f40e7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:22.674207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4be5a-dc26-488d-9629-9d603f40e7db service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:22.684290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 764/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:26.141893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6b4f-e017-45e9-a008-b55af9fe5c71 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:26.142446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6b4f-e017-45e9-a008-b55af9fe5c71 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:26.142546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6b4f-e017-45e9-a008-b55af9fe5c71 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:26.144786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:26.149635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd000d-0e40-4d7f-8a72-ec3c4594d3ae None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:26.150074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd000d-0e40-4d7f-8a72-ec3c4594d3ae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:26.150205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd000d-0e40-4d7f-8a72-ec3c4594d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:26.172304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-99bd000d-0e40-4d7f-8a72-ec3c4594d3ae None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:26.173522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99bd000d-0e40-4d7f-8a72-ec3c4594d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:26.181616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:26.488510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6b4f-e017-45e9-a008-b55af9fe5c71 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:26.490223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e91b6b4f-e017-45e9-a008-b55af9fe5c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:26.554148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:26.567618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6b4f-e017-45e9-a008-b55af9fe5c71 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:26.571197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa814b-e9b2-4f0b-ae2a-593871d2ad45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:26.571809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa814b-e9b2-4f0b-ae2a-593871d2ad45 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:26.572093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa814b-e9b2-4f0b-ae2a-593871d2ad45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:26.572367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa814b-e9b2-4f0b-ae2a-593871d2ad45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:26.581122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa814b-e9b2-4f0b-ae2a-593871d2ad45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:26.583057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa814b-e9b2-4f0b-ae2a-593871d2ad45 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:26.592386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 771/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:28.587604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778e2f3-7e15-4622-9982-0a5a43b66acb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:28.588170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778e2f3-7e15-4622-9982-0a5a43b66acb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:28.588170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778e2f3-7e15-4622-9982-0a5a43b66acb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:28.589536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 29 04:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:41:28.594622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f0251-ef00-4308-98f2-577a9e29c88d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:28.595053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f0251-ef00-4308-98f2-577a9e29c88d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:28.595191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f0251-ef00-4308-98f2-577a9e29c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:28.615413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8f4f0251-ef00-4308-98f2-577a9e29c88d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:41:28.616604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8f4f0251-ef00-4308-98f2-577a9e29c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:28.624571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 29 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:41:28.930788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778e2f3-7e15-4622-9982-0a5a43b66acb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:41:28.932530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d778e2f3-7e15-4622-9982-0a5a43b66acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:41:28.946476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778e2f3-7e15-4622-9982-0a5a43b66acb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:41:28.949950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893cad7-f814-479f-a219-4b8e25017c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:41:28.950557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893cad7-f814-479f-a219-4b8e25017c4a service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:41:28.950838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893cad7-f814-479f-a219-4b8e25017c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:41:28.951113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893cad7-f814-479f-a219-4b8e25017c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:41:28.960038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893cad7-f814-479f-a219-4b8e25017c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:41:28.961461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893cad7-f814-479f-a219-4b8e25017c4a service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:41:28.970860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 767/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:41:38.610083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=11 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:38.966719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=33 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:08.560903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dea56-fe22-4f30-8ac2-18b3ad66a5c7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.562294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dea56-fe22-4f30-8ac2-18b3ad66a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.562690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dea56-fe22-4f30-8ac2-18b3ad66a5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.574424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0529d8-f0e0-4754-b0f3-d66b82950417 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.575001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0529d8-f0e0-4754-b0f3-d66b82950417 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.575001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0529d8-f0e0-4754-b0f3-d66b82950417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.591817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5d3dea56-fe22-4f30-8ac2-18b3ad66a5c7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.593419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5d3dea56-fe22-4f30-8ac2-18b3ad66a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.602167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-de0529d8-f0e0-4754-b0f3-d66b82950417 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.603471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de0529d8-f0e0-4754-b0f3-d66b82950417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.606325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 773/1540] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.612421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 768/1541] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.616446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.617003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.617505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.621285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.621285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.621285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.642394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.643765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.648565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.650029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.655546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 769/1542] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.657638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:08.668082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 774/1543] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.674260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:08.679342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c305bd-c44c-4e12-8eaf-ae63e04161d0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:08.687872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701519-6458-47a7-80b2-dfb7a4a3d0ae None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:08.689288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:08.689955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.690228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.690506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.691206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:08.691508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:08.693730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:43:08.693730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:43:08.693730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:43:08.694629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba48a-4fcd-4085-9539-3b582eb8ddc5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:08.699603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:08.700232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.700511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.700784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.701484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:08.701812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:08.703419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcac9ab-217e-42a6-a593-98deab2fc870 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:08.721653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 770/1544] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:08.722927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.723214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.723487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.741192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 775/1545] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:08.742601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e930d7-c216-4cc4-a32c-e7c1bc5e68fb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.742889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e930d7-c216-4cc4-a32c-e7c1bc5e68fb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.743166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e930d7-c216-4cc4-a32c-e7c1bc5e68fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.758877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.760081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.783363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 771/1546] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.784277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:08.785547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c7e930d7-c216-4cc4-a32c-e7c1bc5e68fb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.786833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c7e930d7-c216-4cc4-a32c-e7c1bc5e68fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.800038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ef979-b7ce-495f-9869-2b206373ec3a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:08.812711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b1fec-68cf-4460-8067-2d56a10bd5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:08.813471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b1fec-68cf-4460-8067-2d56a10bd5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.813781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b1fec-68cf-4460-8067-2d56a10bd5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.814049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b1fec-68cf-4460-8067-2d56a10bd5bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.814170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 776/1547] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.814800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b1fec-68cf-4460-8067-2d56a10bd5bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:08.815743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.816651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.817016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.817202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b1fec-68cf-4460-8067-2d56a10bd5bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:08.843318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.844652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.854419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 777/1548] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.855271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:08.871514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 772/1549] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:08.871514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00784-7b4f-45da-9d64-70d37e9cf5e0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.871514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00784-7b4f-45da-9d64-70d37e9cf5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.871514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00784-7b4f-45da-9d64-70d37e9cf5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.873004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7266-cae6-4297-8450-5084f396379e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:08.890654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-89a00784-7b4f-45da-9d64-70d37e9cf5e0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.891914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-89a00784-7b4f-45da-9d64-70d37e9cf5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.934918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:08.935530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.935816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.936086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.936761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:08.937953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:43:08.937953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:43:08.937953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:43:08.939321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e3d65-95c1-4f37-bb00-6e6e2c7cbaa4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:08.953960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 773/1550] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:08.955673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7000-03c5-4a30-922c-41adf013e56a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.956088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7000-03c5-4a30-922c-41adf013e56a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.956433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7000-03c5-4a30-922c-41adf013e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.967770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 778/1551] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:08.969774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bdd7-5e19-49b3-9fd3-acdfc7996730 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:08.970160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bdd7-5e19-49b3-9fd3-acdfc7996730 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:08.970500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bdd7-5e19-49b3-9fd3-acdfc7996730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:08.976737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b23e7000-03c5-4a30-922c-41adf013e56a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.978036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b23e7000-03c5-4a30-922c-41adf013e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:08.989764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4399bdd7-5e19-49b3-9fd3-acdfc7996730 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:08.990936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4399bdd7-5e19-49b3-9fd3-acdfc7996730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.037884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 774/1552] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.039340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7865fac-afa3-4038-985d-6a46d6d37098 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.039660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7865fac-afa3-4038-985d-6a46d6d37098 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.039940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7865fac-afa3-4038-985d-6a46d6d37098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.054238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 779/1553] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.055496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.055786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.056499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.062028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b7865fac-afa3-4038-985d-6a46d6d37098 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:09.063841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7865fac-afa3-4038-985d-6a46d6d37098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.072026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 775/1554] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.073268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.073558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.073968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.081518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:09.082841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.090723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 780/1555] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.091469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.093477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:09.094833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.101254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b11bb-1a5e-49bc-8646-72104c0264a6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.103049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 776/1556] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.103885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.105821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.106591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.106725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.106990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.107676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.110139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.113342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3a84-ebc9-42c7-9c11-1104f71f75a9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.117942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.118534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.118815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.119089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.119810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:09.120103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.121721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed42c06-af4e-4bed-bac0-21d54a6432cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.132574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 781/1557] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.133288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.138161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 777/1558] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:09.139554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.139754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.140001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.144561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61eddc-6405-48e0-b0f5-13265856a600 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.149333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced8a8-6b3e-4721-a7ce-2fdc35996515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.149973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced8a8-6b3e-4721-a7ce-2fdc35996515 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.150259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced8a8-6b3e-4721-a7ce-2fdc35996515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.150545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced8a8-6b3e-4721-a7ce-2fdc35996515 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.151286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efced8a8-6b3e-4721-a7ce-2fdc35996515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.153208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efced8a8-6b3e-4721-a7ce-2fdc35996515 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.160196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:09.161376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.171202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 778/1559] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.171985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.180503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 782/1560] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.180692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:09.180855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.180855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.180855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.182810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab12f7-7b22-4c56-a647-ebb0b3ba1983 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.188805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.189945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:09.190070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.190070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.190271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.191193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:09.191508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.193107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd725e-e5cb-40ce-8f4f-461dbd63c513 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.201419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:09.202663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.205030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 779/1561] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:09.206927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.208282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.210398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.216754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 783/1562] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.217841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.227869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8125b-53bb-4eaf-8cae-e3c4fee1f539 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.232417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.233017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.233295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.233528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:09.233661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.234305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:09.234607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.234754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:09.236836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.243724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 780/1563] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:09.244579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.260503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 784/1564] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:09.260716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc48f51-e561-4e62-9d66-159c02b61ecf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.260814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.260922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.260922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.260922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.260922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.261242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.262321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.266655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9732a7-23fb-4672-ba5f-6b3272184766 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.271458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.272069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.272358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.272509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 781/1565] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:09.272665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.273298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.275278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.276324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.286367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cb491-e483-430d-9fb3-c70b6646d2fd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.290943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.291526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.291813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.292088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.292762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:09.293068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.294853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.305018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 785/1566] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.305970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.315155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 782/1567] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:09.315155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.324413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db5553-9cea-4bec-ab04-c8f66d9c4d13 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.366263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01689-8c7e-4907-b78f-87711ad9094c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.370779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.371515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.371795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.372065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.372750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.374405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.379582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.380197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.380479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.380783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.381562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.383476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.384311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 786/1568] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:09.385107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.395245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d116c-e2ad-483f-9c6b-1847d9c09399 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.399990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.400635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.400940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.401340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.402184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:09.402589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.404334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.414465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 783/1569] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.414465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.422908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 787/1570] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:09.422908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.429971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9a3bf-d074-4355-8289-ee94c8ae0af8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.478924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4ca5-8c2d-4337-843b-68d47288f7a1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.483662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.484280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.484567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.485344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.486079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:09.486386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.486916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.487597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.487943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.488046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.488336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.489090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.491242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.499805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 784/1571] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:09.500988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.511417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f02c-1b59-46a2-8850-5b75c1c98b21 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.516625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.517236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.517522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.517836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.518524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.521828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 788/1572] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.521828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.522072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.531140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 785/1573] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:09.531966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.541216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e62b-515d-4c1b-b0b3-fa5f66a6c250 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.555513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:09.568026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:09.585276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ce7cc-1cac-4b8a-9b5f-fe984f25ee7d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.589921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.590542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.590826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.591121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.591776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.593702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.599630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.600282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.600596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.600869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.601529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.603644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.613858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 789/1574] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.614665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.624488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b294a-d7ef-481d-8996-c79c3b7893fb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.630234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.630846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.631242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.631631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.632325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.632917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 786/1575] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.633755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.634884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.646013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 790/1576] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:09.646646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.656114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b96ac-2f89-4f52-b340-3ec4bdd6a2d2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.697851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec87c-40cd-4f0a-bee8-5cb0db30802f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.702967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:43:09.709514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:43:09.710110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.713406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.714071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.714351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.714622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.715278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.717175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.731309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 787/1577] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.732182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.742926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4297ba-187a-4fd3-bf55-4b5bddea8351 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.750453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 791/1578] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.750613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.750729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.750810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.750810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.750810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.750810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.751290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.778093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 788/1579] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.778973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.814550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320238-118f-43f8-8905-b10759496a20 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.843984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336843fd-1676-4ca9-9100-3e8466ce5513 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.849340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.850040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.850320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.850596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] PATH_INFO: `/v3/projects/b217c5f905674844b119f4ebda4e7bfe/users/f7c90d7345494021b6bf01b815a31d1d/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.857921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:09.866401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217c5f905674844b119f4ebda4e7bfe, user_id=f7c90d7345494021b6bf01b815a31d1d, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.869041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.876686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.877563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.877945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.878294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.878960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.880861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.882462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 789/1580] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:09 2022] PUT /identity/v3/projects/b217c5f905674844b119f4ebda4e7bfe/users/f7c90d7345494021b6bf01b815a31d1d/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:09.883258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.895396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:09.904624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 792/1581] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:09.905508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.915056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723075-78ca-41b6-8988-160aadeb36f3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.959265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44418b-8a77-45e7-9d6d-747441038149 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.964109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.964728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.965014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.965290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.966011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.967606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.972090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.972709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.972979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.973261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.973948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:09.975915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:09.977711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 790/1582] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:09.978556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:09.988388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98db07-2914-4892-ad75-a5d37fc9d980 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:09.993717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:09.994364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:09.994655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:09.994924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] PATH_INFO: `/v3/projects/1eefa33951d84d969cf7174b1622724b/users/3cf68e097d3941218efae9a5ef5bba12/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:09.997815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 793/1583] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:09 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:10.002061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.010755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eefa33951d84d969cf7174b1622724b, user_id=3cf68e097d3941218efae9a5ef5bba12, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.011862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987866-f9a8-4f74-adfa-36b3c58fec17 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.013416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.017295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.017925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.018273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.018571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.019446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.021096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.027061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 791/1584] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:09 2022] PUT /identity/v3/projects/1eefa33951d84d969cf7174b1622724b/users/3cf68e097d3941218efae9a5ef5bba12/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:10.027838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.032003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 794/1585] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.032788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.042144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cef3-4ea9-4896-850f-f31ac1ceb9c2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.094419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81ad5-cfc0-4751-b0d4-d8bd8c2f98af admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.099266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be923524-47e2-4c62-9810-0907c3f672e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.099888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be923524-47e2-4c62-9810-0907c3f672e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.100175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be923524-47e2-4c62-9810-0907c3f672e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.100454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be923524-47e2-4c62-9810-0907c3f672e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.101119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be923524-47e2-4c62-9810-0907c3f672e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.102264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.102891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.103076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be923524-47e2-4c62-9810-0907c3f672e5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.103193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.103441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.104104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.106043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.126103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 792/1586] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:10.127327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.127615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.127886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.132144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 795/1587] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:10.132863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.142891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986cb3-7e6c-4080-8779-097972828370 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.147611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.148214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.148500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.148777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.149465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.151096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.160345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] MFA Rules not processed for user `f7c90d7345494021b6bf01b815a31d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:10.161574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:10.164654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 796/1588] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.164654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.171615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206ad7-cc95-4cfd-a14c-58cb1716844c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.176640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.177263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.177548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.177976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.179144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.181165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.193610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 797/1589] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.194427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.204461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4d5fc-8c6a-4c84-891b-2f0d8dbd3d77 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.209098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0773-1bfe-490c-9294-6f9c4c2d1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.209714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0773-1bfe-490c-9294-6f9c4c2d1537 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.210006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0773-1bfe-490c-9294-6f9c4c2d1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.210291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0773-1bfe-490c-9294-6f9c4c2d1537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.210941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0773-1bfe-490c-9294-6f9c4c2d1537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.212565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0773-1bfe-490c-9294-6f9c4c2d1537 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.219902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:10.223012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 798/1590] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.224257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.224612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.224936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.233933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 793/1591] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:10.235321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.238369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:10.244221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:10.246225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:10.247566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033556c-61b0-434f-8432-837cb2ac4fd3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.252179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.252797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.253082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.253360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.253882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 799/1592] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:10.254089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.254650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.255822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.264087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289581c6-87f4-4033-ba3d-d3dd5057dc09 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.266772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 794/1593] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.267632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.271556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.272177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.272453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.272728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.273421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.275049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.279198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641973d9-be73-47cd-a495-05dca69341bb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.285790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.286029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 800/1594] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.286726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.289363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.289684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.289973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.291075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.293857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.296236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89655805-03d2-4c61-b0f2-41db6db1070d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.300822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.301721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.301989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.302261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.302937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.304512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.309973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 795/1595] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.311148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.314297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 801/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.315066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.322723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979797e-1a59-41b6-9d14-59a1415fd30a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.327747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ecd20-7404-46e9-8855-3ee7cef746e3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.328318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.329478 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.329806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.330086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] PATH_INFO: `/v3/projects/8115f56128fd44f3beebe79b49d403c0/users/7137e696c39443a7a1e5c6b92d74cec5/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.332725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.333313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.333620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.333920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.334553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.336117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.345442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8115f56128fd44f3beebe79b49d403c0, user_id=7137e696c39443a7a1e5c6b92d74cec5, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.350280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 802/1597] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.350280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.350514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.357828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2be0-140f-4353-a2ea-ba5f24a083c6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.362704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 796/1598] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:10 2022] PUT /identity/v3/projects/8115f56128fd44f3beebe79b49d403c0/users/7137e696c39443a7a1e5c6b92d74cec5/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:10.363500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.368090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:10.415851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.416463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.416743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.417019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.417704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.419583 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.425303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d101bb-bccc-4d94-a63b-d9c49dbef65f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.429235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.429863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.430152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.430433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.440457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.442015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.445960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 803/1599] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:10.446630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.451926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 797/1600] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:10.452717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.462279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be559-140b-4fd3-a625-2388cde54ea9 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.515884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd4644-1dfe-4b64-a7bd-3fc05c61721b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.521482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.522252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.522539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.522822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] PATH_INFO: `/v3/projects/91faeda53f724ffe9a621656d68e4b03/users/08409a936bd44b31b613b727587e79ae/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.525987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.526605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.526892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.527171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.527991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.529909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.539488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=91faeda53f724ffe9a621656d68e4b03, user_id=08409a936bd44b31b613b727587e79ae, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.540744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:43:10.540744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:43:10.540744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:43:10.543071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.547142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 798/1601] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.548089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.559508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231761e-bec9-4722-8bea-508b93d6a8cb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.561272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 804/1602] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:10 2022] PUT /identity/v3/projects/91faeda53f724ffe9a621656d68e4b03/users/08409a936bd44b31b613b727587e79ae/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:10.562555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.611709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:10.613104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:10.627203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.627851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.628340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.628986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.629732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.631371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.638711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18639ffe-fd0c-4420-bcfa-3f54e75d0bbf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.645293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305935f-8c4f-4b0c-97fb-6f2b70c986d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.646100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305935f-8c4f-4b0c-97fb-6f2b70c986d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.648867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305935f-8c4f-4b0c-97fb-6f2b70c986d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.648867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305935f-8c4f-4b0c-97fb-6f2b70c986d5 admin admin] PATH_INFO: `/v3/projects/5e9bbac0ad274e069d4a56d0747d34f6/users/89efe9625ac545a892adcd1d01d818a0/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.649005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 799/1603] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:10.649005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.667458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305935f-8c4f-4b0c-97fb-6f2b70c986d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9bbac0ad274e069d4a56d0747d34f6, user_id=89efe9625ac545a892adcd1d01d818a0, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.670178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305935f-8c4f-4b0c-97fb-6f2b70c986d5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.671518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fc12e-3a1b-4e67-8805-3a9f5547d1ef admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.677204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.677933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.678230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.678546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] PATH_INFO: `/v3/projects/f64239b9685e4525962422bb38c0af70/users/ed9af3aef04b482c83c05498eebc5fb0/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.689691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 805/1604] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:10 2022] PUT /identity/v3/projects/5e9bbac0ad274e069d4a56d0747d34f6/users/89efe9625ac545a892adcd1d01d818a0/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:10.692092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.692527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.692925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.707009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64239b9685e4525962422bb38c0af70, user_id=ed9af3aef04b482c83c05498eebc5fb0, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.709929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.715312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:10.716525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:10.727289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 800/1605] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:10 2022] PUT /identity/v3/projects/f64239b9685e4525962422bb38c0af70/users/ed9af3aef04b482c83c05498eebc5fb0/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:10.727890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.801677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 806/1606] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:10.804048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.807788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f267c-bfce-4ba2-80fd-0841eac639d7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.815751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75dfd6-8620-4166-aedb-de01d73719b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.816625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75dfd6-8620-4166-aedb-de01d73719b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.817079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75dfd6-8620-4166-aedb-de01d73719b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.817545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75dfd6-8620-4166-aedb-de01d73719b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.818573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75dfd6-8620-4166-aedb-de01d73719b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.819706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702af0e-f35e-4d7b-b542-fbb65456558f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.820629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75dfd6-8620-4166-aedb-de01d73719b2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.825436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.826280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.826658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.827032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] PATH_INFO: `/v3/projects/0b01c97a73084744bcbb93e334a14536/users/8990ee8f728f4dea9686b4819ee28fd7/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.845100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 801/1607] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:10.845314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b01c97a73084744bcbb93e334a14536, user_id=8990ee8f728f4dea9686b4819ee28fd7, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.846561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af88a8-54ef-4d6e-b8b9-fcd0fd29b8c7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.846854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af88a8-54ef-4d6e-b8b9-fcd0fd29b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.847130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af88a8-54ef-4d6e-b8b9-fcd0fd29b8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.848346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:10.868272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 807/1608] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:10 2022] PUT /identity/v3/projects/0b01c97a73084744bcbb93e334a14536/users/8990ee8f728f4dea9686b4819ee28fd7/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:10.873942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:10.880058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-48af88a8-54ef-4d6e-b8b9-fcd0fd29b8c7 None None] MFA Rules not processed for user `08409a936bd44b31b613b727587e79ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:10.881270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48af88a8-54ef-4d6e-b8b9-fcd0fd29b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:10.964045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d2b9-e991-47be-bbbd-27584b4c67d0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:10.964292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 802/1609] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:10.965480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.965800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.966065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.971426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706594c-5683-4c7c-9a55-fdf6e25097c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:10.972526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706594c-5683-4c7c-9a55-fdf6e25097c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:10.973144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706594c-5683-4c7c-9a55-fdf6e25097c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:10.973712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706594c-5683-4c7c-9a55-fdf6e25097c0 admin admin] PATH_INFO: `/v3/projects/78289a4a0dba461fa416082ae84a1880/users/b2e41aeff8cd43a1ae221b6cbfce2dab/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:10.993584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706594c-5683-4c7c-9a55-fdf6e25097c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78289a4a0dba461fa416082ae84a1880, user_id=b2e41aeff8cd43a1ae221b6cbfce2dab, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:10.996745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706594c-5683-4c7c-9a55-fdf6e25097c0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.011229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] MFA Rules not processed for user `89efe9625ac545a892adcd1d01d818a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:11.013020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:11.016876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 808/1610] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:10 2022] PUT /identity/v3/projects/78289a4a0dba461fa416082ae84a1880/users/b2e41aeff8cd43a1ae221b6cbfce2dab/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:11.018311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.018703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.019134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.048657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:11.050630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] MFA Rules not processed for user `ed9af3aef04b482c83c05498eebc5fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:11.052329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:11.059181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:11.094831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 803/1611] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:11.094831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.139479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 809/1612] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:11.140646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.190859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27f89-d708-4d03-8ea8-26d2ec888416 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.195333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c3cb2-a0d3-4d5d-b20c-8fe058267ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.196059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3cb2-a0d3-4d5d-b20c-8fe058267ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.196267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3cb2-a0d3-4d5d-b20c-8fe058267ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.196548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c3cb2-a0d3-4d5d-b20c-8fe058267ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.257125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3d2f8-21e0-4e1f-922e-f79b6b39254c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.263667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58ed8e-748b-4176-8353-040fbb908e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.264298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58ed8e-748b-4176-8353-040fbb908e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.264578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58ed8e-748b-4176-8353-040fbb908e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.264854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58ed8e-748b-4176-8353-040fbb908e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.265747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58ed8e-748b-4176-8353-040fbb908e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.268057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58ed8e-748b-4176-8353-040fbb908e03 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.283482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 810/1613] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:11.283482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.283482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.283482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.291186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c3cb2-a0d3-4d5d-b20c-8fe058267ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.294708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c3cb2-a0d3-4d5d-b20c-8fe058267ec8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.306553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:11.307865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:11.310795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 804/1614] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:11.312860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301fc9-6651-49da-853f-de80891c4a16 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.313870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301fc9-6651-49da-853f-de80891c4a16 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.314156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301fc9-6651-49da-853f-de80891c4a16 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.316549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 805/1615] 10.222.0.46 () {54 vars in 962 bytes} [Fri Jul 29 04:43:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:43:11.317758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3199-3691-46ae-9caa-6f06d6602641 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.318050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3199-3691-46ae-9caa-6f06d6602641 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.318333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3199-3691-46ae-9caa-6f06d6602641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.322598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 811/1616] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:11.323877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.352062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-605e3199-3691-46ae-9caa-6f06d6602641 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:11.353545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-605e3199-3691-46ae-9caa-6f06d6602641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:11.365862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 806/1617] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:11.365862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ea97-af78-4e27-a695-48ca20e6f32a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.365862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ea97-af78-4e27-a695-48ca20e6f32a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.365862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ea97-af78-4e27-a695-48ca20e6f32a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.373163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 807/1618] 10.222.0.46 () {54 vars in 962 bytes} [Fri Jul 29 04:43:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:43:11.374155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ea97-af78-4e27-a695-48ca20e6f32a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.388819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ea97-af78-4e27-a695-48ca20e6f32a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.395092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dd7b2-8279-4f2e-bd71-136d13dec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.395927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dd7b2-8279-4f2e-bd71-136d13dec37f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.396317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dd7b2-8279-4f2e-bd71-136d13dec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.396700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dd7b2-8279-4f2e-bd71-136d13dec37f admin admin] PATH_INFO: `/v3/projects/c1ed639f7bde4a7e8b6ea4ad9be18e18/users/557fdd30a45c440fab520ea5aabc9c2a/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.413081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dd7b2-8279-4f2e-bd71-136d13dec37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ed639f7bde4a7e8b6ea4ad9be18e18, user_id=557fdd30a45c440fab520ea5aabc9c2a, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.417030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dd7b2-8279-4f2e-bd71-136d13dec37f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.429819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c3b1-d5ad-4851-8b1a-74c7ab740a3a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.433265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 808/1619] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:11 2022] PUT /identity/v3/projects/c1ed639f7bde4a7e8b6ea4ad9be18e18/users/557fdd30a45c440fab520ea5aabc9c2a/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:11.434672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.435023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.435248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.491742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:11.493576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:11.495133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb593d2-a85f-41ee-8724-d94a29b668e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.496455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb593d2-a85f-41ee-8724-d94a29b668e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.496980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb593d2-a85f-41ee-8724-d94a29b668e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.497401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb593d2-a85f-41ee-8724-d94a29b668e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.508330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:11.532456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:11.591613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb593d2-a85f-41ee-8724-d94a29b668e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.593449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb593d2-a85f-41ee-8724-d94a29b668e3 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.598491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 809/1620] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Jul 29 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:11.600117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.606255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 812/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:11.609685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.610739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.611352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.640698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:11.642310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:11.664126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 813/1622] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Jul 29 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:11.664500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.729052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0023-2d3d-46d1-86d6-5c381ba81758 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.734200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.735740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.736434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.737321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.746640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f0ac-a29b-487f-bc0d-355f4998d1fe None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.751525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.752787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.753085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.753380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.833401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.835583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.838314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.839940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.857013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 810/1623] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:11.858327 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.863855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 814/1624] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:11.864873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.894538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdd0a5-7d7b-45c8-9bd3-2470afa5c570 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.895808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdc4c3-36bf-4fc6-8ba1-e8edd5323acf service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.908935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.909578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.909914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.910158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.915925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.916643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.916940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.917405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:11.918669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:11.920634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:11.952791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 811/1625] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:11.953800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:11.976422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636131-e2f2-4e22-989c-542d1cb563bc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:11.996565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ccf43-809b-4b34-9998-314723d9c7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:11.997357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ccf43-809b-4b34-9998-314723d9c7dc service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:11.997672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ccf43-809b-4b34-9998-314723d9c7dc service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:11.997947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ccf43-809b-4b34-9998-314723d9c7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.048132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:12.072322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:12.073883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:12.107193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ccf43-809b-4b34-9998-314723d9c7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:12.109147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ccf43-809b-4b34-9998-314723d9c7dc service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:12.117941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 815/1626] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:12.121411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:12.122965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 812/1627] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:12.138146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2edc0-88ca-46b5-a60c-964197023118 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:12.145928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:12.146993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.147714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.148273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] PATH_INFO: `/v3/projects/c1ed639f7bde4a7e8b6ea4ad9be18e18/users/557fdd30a45c440fab520ea5aabc9c2a/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.151131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ed639f7bde4a7e8b6ea4ad9be18e18, user_id=557fdd30a45c440fab520ea5aabc9c2a, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:12.156498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:12.184755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 816/1628] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:12 2022] PUT /identity/v3/projects/c1ed639f7bde4a7e8b6ea4ad9be18e18/users/557fdd30a45c440fab520ea5aabc9c2a/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:12.187048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9327b6-44ba-4292-9e4a-2d4696ef29f5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.187424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9327b6-44ba-4292-9e4a-2d4696ef29f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.188527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9327b6-44ba-4292-9e4a-2d4696ef29f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.204643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:12.256483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5c9327b6-44ba-4292-9e4a-2d4696ef29f5 None None] MFA Rules not processed for user `557fdd30a45c440fab520ea5aabc9c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:12.260571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5c9327b6-44ba-4292-9e4a-2d4696ef29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:12.438036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 813/1629] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:12.458410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:12.535559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9d67-1b86-4e1e-b2de-831c968e2aec None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.535559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9d67-1b86-4e1e-b2de-831c968e2aec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.535947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9d67-1b86-4e1e-b2de-831c968e2aec None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.537234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 814/1630] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 29 04:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:43:12.542886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc4dd-625c-46fc-a269-44f0592e4f09 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.543176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc4dd-625c-46fc-a269-44f0592e4f09 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.543622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc4dd-625c-46fc-a269-44f0592e4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.599058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b9fbc4dd-625c-46fc-a269-44f0592e4f09 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:12.600311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b9fbc4dd-625c-46fc-a269-44f0592e4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:12.646222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78048be-0c05-4684-b2bb-33f667c6143c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:12.662701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d114d8-ada5-48bf-af9e-c4ea4a5cae8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:12.663438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d114d8-ada5-48bf-af9e-c4ea4a5cae8c service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.663742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d114d8-ada5-48bf-af9e-c4ea4a5cae8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.664023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d114d8-ada5-48bf-af9e-c4ea4a5cae8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.694528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d114d8-ada5-48bf-af9e-c4ea4a5cae8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:12.700528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d114d8-ada5-48bf-af9e-c4ea4a5cae8c service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:12.814627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 817/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:12.821887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636351e-81ff-45c4-a13e-66936baebe7f None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.822479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636351e-81ff-45c4-a13e-66936baebe7f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.822839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636351e-81ff-45c4-a13e-66936baebe7f None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.824867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 818/1632] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 29 04:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:43:12.851458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 815/1633] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:43:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:12.868730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636351e-81ff-45c4-a13e-66936baebe7f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:12.876112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.876408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.876691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.915450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636351e-81ff-45c4-a13e-66936baebe7f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:12.946827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:12.947545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:12.947853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:12.948130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:12.962555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:12.963799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:12.980831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:12.984415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:12.992051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 816/1634] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:43:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:12.992941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:13.015312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 819/1635] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:13.018097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926e682-80a9-4c85-b6aa-816bf10e8572 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:13.023701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:13.024328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:13.024607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:13.024881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:13.166663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:13.168226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:13.192439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 817/1636] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:13.446990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:13.459402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6ca5-40bc-4ab3-a2e1-6cbac9e88dac service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:13.472514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b499ec-95f3-4c84-a8e8-11e468cd6351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:13.474655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b499ec-95f3-4c84-a8e8-11e468cd6351 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:13.476120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b499ec-95f3-4c84-a8e8-11e468cd6351 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:13.476593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b499ec-95f3-4c84-a8e8-11e468cd6351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:13.524759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b499ec-95f3-4c84-a8e8-11e468cd6351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:13.534855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b499ec-95f3-4c84-a8e8-11e468cd6351 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:13.564522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 820/1637] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:17.124325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:17.144908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:17.308651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f29318-42cd-4251-b94e-31b99099d2e1 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:17.320188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:17.321014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:17.321471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:17.321988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] PATH_INFO: `/v3/users/08409a936bd44b31b613b727587e79ae` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:17.323473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08409a936bd44b31b613b727587e79ae)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:17.325578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:17.432127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08409a936bd44b31b613b727587e79ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:17.450740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08409a936bd44b31b613b727587e79ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:17.451908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08409a936bd44b31b613b727587e79ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:17.453571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08409a936bd44b31b613b727587e79ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:17.486365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08409a936bd44b31b613b727587e79ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:17.516265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 818/1638] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:17 2022] DELETE /identity/v3/users/08409a936bd44b31b613b727587e79ae => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:17.521075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:17.521562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:17.521670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:17.584053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:17.587077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:17.755459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 821/1639] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:17.810505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:17.814080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:18.028863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d88e6-0083-45a5-9413-f4eb8e52ac99 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:18.048283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad86f-cd44-46e8-a95b-8fbcd03ce8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:18.048940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad86f-cd44-46e8-a95b-8fbcd03ce8cd service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:18.049228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad86f-cd44-46e8-a95b-8fbcd03ce8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:18.049502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad86f-cd44-46e8-a95b-8fbcd03ce8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:18.084754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ad86f-cd44-46e8-a95b-8fbcd03ce8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:18.086280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ad86f-cd44-46e8-a95b-8fbcd03ce8cd service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:18.120837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 819/1640] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:20.770387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:20.772587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:20.794163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd13f-9563-4043-8646-3ceff1629af8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:20.817847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:20.818522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:20.818812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:20.819093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] PATH_INFO: `/v3/users/ed9af3aef04b482c83c05498eebc5fb0` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:20.820917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9af3aef04b482c83c05498eebc5fb0)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:20.821970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: WARNING py.warnings [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:43:20.821970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: warnings.warn(msg) Jul 29 04:43:20.821970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: Jul 29 04:43:20.828000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:21.004538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9af3aef04b482c83c05498eebc5fb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:21.006865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:21.030416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9af3aef04b482c83c05498eebc5fb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:21.031380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9af3aef04b482c83c05498eebc5fb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:21.032665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9af3aef04b482c83c05498eebc5fb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:21.071258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9af3aef04b482c83c05498eebc5fb0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:21.097261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 822/1641] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:20 2022] DELETE /identity/v3/users/ed9af3aef04b482c83c05498eebc5fb0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:43:21.102979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:21.104171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:21.104636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:21.158935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:21.161018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:21.231861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:21.297254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 820/1642] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:21.316887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:21.319190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:21.482053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526346d-76b6-4db5-9d13-4c5d37497446 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:21.488341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed969ad-a85f-4337-97f4-22fb999b8bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:21.488996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed969ad-a85f-4337-97f4-22fb999b8bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:21.489282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed969ad-a85f-4337-97f4-22fb999b8bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:21.496295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed969ad-a85f-4337-97f4-22fb999b8bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:21.519090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed969ad-a85f-4337-97f4-22fb999b8bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:21.520744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed969ad-a85f-4337-97f4-22fb999b8bc2 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:21.546965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 823/1643] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:21.944861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:21.949171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:21.975374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d46b7-0f85-4b66-b0b4-b8adc00511c5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:21.999500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:22.000791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.001079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.001360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] PATH_INFO: `/v3/projects/91faeda53f724ffe9a621656d68e4b03` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.002776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91faeda53f724ffe9a621656d68e4b03)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:22.006737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:43:22.006737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 29 04:43:22.006737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: Jul 29 04:43:22.009982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:22.172565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91faeda53f724ffe9a621656d68e4b03', 'request_id': 'req-fae24027-e479-4ed5-b532-4bd012a96004'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.206972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91faeda53f724ffe9a621656d68e4b03', 'request_id': 'req-fae24027-e479-4ed5-b532-4bd012a96004'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.225425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91faeda53f724ffe9a621656d68e4b03', 'request_id': 'req-fae24027-e479-4ed5-b532-4bd012a96004'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.263748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] The token cache is being invalidate because project 91faeda53f724ffe9a621656d68e4b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:22.264117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.265178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.271254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 821/1644] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:21 2022] DELETE /identity/v3/projects/91faeda53f724ffe9a621656d68e4b03 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:22.276091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adf44-c59d-4e85-bf4e-0ff7ab0bddcf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.276622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adf44-c59d-4e85-bf4e-0ff7ab0bddcf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.276706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adf44-c59d-4e85-bf4e-0ff7ab0bddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.349456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-367adf44-c59d-4e85-bf4e-0ff7ab0bddcf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:22.351304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-367adf44-c59d-4e85-bf4e-0ff7ab0bddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:22.553700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:22.555413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:22.579709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 824/1645] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:22.581334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.581924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.582459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.590100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae24027-e479-4ed5-b532-4bd012a96004 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:22.610515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:22.611253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.612162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.612451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] PATH_INFO: `/v3/users/f7c90d7345494021b6bf01b815a31d1d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.616132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c90d7345494021b6bf01b815a31d1d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:22.620955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:22.634344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:22.635843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:22.660123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 825/1646] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:22.661049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:22.676786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea456a4f-083c-4452-977a-2cbe7e27b39a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:22.691686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:22.692779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.693268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.694140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.695059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:22.695743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:22.697714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:22.728607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 826/1647] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:22.731176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c90d7345494021b6bf01b815a31d1d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.736124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:22.748807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c90d7345494021b6bf01b815a31d1d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.752479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c90d7345494021b6bf01b815a31d1d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.753719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c90d7345494021b6bf01b815a31d1d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.759378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77edc-8f19-4a06-95a6-2993a8e2b883 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:22.773652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:22.774693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.774693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.775130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.776225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:22.784362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4822a632-aa81-4fb2-9567-8754a35f6682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c90d7345494021b6bf01b815a31d1d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:22.784614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:22.821960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 822/1648] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:22 2022] DELETE /identity/v3/users/f7c90d7345494021b6bf01b815a31d1d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:22.827851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962769a-c953-4931-ae0d-ed48e8ae3b8e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:22.830284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962769a-c953-4931-ae0d-ed48e8ae3b8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:22.830284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962769a-c953-4931-ae0d-ed48e8ae3b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:22.847992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 827/1649] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:22 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:22.853291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:22.858028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:22.884574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5962769a-c953-4931-ae0d-ed48e8ae3b8e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:22.885929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5962769a-c953-4931-ae0d-ed48e8ae3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:22.940275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:22.961376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:23.019675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2708-8608-4846-a14b-772804d221bc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.027625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.028444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.028848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.030252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.031283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.035245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:23.046029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 823/1650] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:23.046029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.046029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.046029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.084931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 828/1651] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:22 2022] POST /identity/v3/users => generated 281 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:23.085984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:23.104756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256017bc-6b84-4914-af1a-e329362f5c05 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.112923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] MFA Rules not processed for user `3cf68e097d3941218efae9a5ef5bba12`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:23.114886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:23.119784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.120685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.121064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.121418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.122223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.123939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:23.158410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 829/1652] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:23.162873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:23.168180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:23.293743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 824/1653] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:23.294766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:23.311681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cef78-45dc-4b74-ba62-ab3918cf3e5c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.315430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fda76f-99ab-4aeb-929d-0e67cf614743 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.316649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.317440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.317904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.318353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.330214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.330988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.331309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.331707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.332431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.334257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:23.334851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.339828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:23.353198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 830/1654] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:23.357076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 825/1655] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:23.358550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:23.358770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:23.364824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:23.379196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7083-2963-4282-b10d-0a80da26c059 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.393115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41fe2-5b65-42a6-a251-4fb5c658852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.393850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41fe2-5b65-42a6-a251-4fb5c658852d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.394132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41fe2-5b65-42a6-a251-4fb5c658852d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.394409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41fe2-5b65-42a6-a251-4fb5c658852d admin admin] PATH_INFO: `/v3/projects/fc71c837ce4f420dae876bec51adef3e/users/8034a83f4ac64a7b8f43bff6eb0808bd/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.433352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e41fe2-5b65-42a6-a251-4fb5c658852d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc71c837ce4f420dae876bec51adef3e, user_id=8034a83f4ac64a7b8f43bff6eb0808bd, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.438879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e41fe2-5b65-42a6-a251-4fb5c658852d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:23.478193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 826/1656] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:23 2022] PUT /identity/v3/projects/fc71c837ce4f420dae876bec51adef3e/users/8034a83f4ac64a7b8f43bff6eb0808bd/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:23.480263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.480932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.481036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.500921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a048c-7a38-4596-a85e-f6cd824151ee service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.539199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] MFA Rules not processed for user `8034a83f4ac64a7b8f43bff6eb0808bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:23.541967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:23.606305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:23.654160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.654843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.655160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.655485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.682713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 827/1657] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:23.684253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:23.747076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:23.777875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.779604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:23.802634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 831/1658] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:23.924061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361801e-e55e-4509-a11b-0076746a2408 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:23.950897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:23.951555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:23.951913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:23.952181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:23.952862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:23.956305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:24.023226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 828/1659] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:23 2022] POST /identity/v3/projects => generated 363 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:24.024560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:24.043104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcd0b6-244c-4727-b64c-a4089317155e service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:24.110894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:24.112741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:24.227885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:24.228488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:24.229696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:24.229976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:24.232042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:24.239429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:24.318244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e3cfc-d61d-42d5-8c85-91a89ebd8edb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:24.322669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 832/1660] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:24 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:43:24.323939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:24.333910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:24.335754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:24.335754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:24.336639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] PATH_INFO: `/v3/projects/f64239b9685e4525962422bb38c0af70` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:24.338317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64239b9685e4525962422bb38c0af70)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:24.340143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:24.346729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23978797-e99e-4761-a59a-2e9201dfaee5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:24.358464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:24.359115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:24.359381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:24.360180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:24.360891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:24.364210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:24.397373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 833/1661] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:43:24.398378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:24.404215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:24.441480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece9de-cf2e-4343-b82b-2461289ca0c8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:24.460687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64239b9685e4525962422bb38c0af70', 'request_id': 'req-7168f830-9e8e-4f39-885a-cc6a9defdaf4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.472757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64239b9685e4525962422bb38c0af70', 'request_id': 'req-7168f830-9e8e-4f39-885a-cc6a9defdaf4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.494021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64239b9685e4525962422bb38c0af70', 'request_id': 'req-7168f830-9e8e-4f39-885a-cc6a9defdaf4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.518346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] The token cache is being invalidate because project f64239b9685e4525962422bb38c0af70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:24.518866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.521207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.523650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 829/1662] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:24 2022] DELETE /identity/v3/projects/f64239b9685e4525962422bb38c0af70 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:43:24.526113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:24.530496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:24.616615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:24.618634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:24.619597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:24.619967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:24.620957 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] PATH_INFO: `/v3/projects/b217c5f905674844b119f4ebda4e7bfe` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:24.622331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b217c5f905674844b119f4ebda4e7bfe)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:24.627363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:24.646146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:24.708630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168f830-9e8e-4f39-885a-cc6a9defdaf4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:24.719891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8a0a2-579d-4a84-a34d-6a243a990982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:24.721499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8a0a2-579d-4a84-a34d-6a243a990982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:24.722452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8a0a2-579d-4a84-a34d-6a243a990982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:24.723105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8a0a2-579d-4a84-a34d-6a243a990982 admin admin] PATH_INFO: `/v3/projects/ebab2f978a6c415eb8e59b62665582e3/users/6cfc3bbcd29a4606a7ca8a2792b03f24/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:24.758511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8a0a2-579d-4a84-a34d-6a243a990982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebab2f978a6c415eb8e59b62665582e3, user_id=6cfc3bbcd29a4606a7ca8a2792b03f24, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:24.765000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8a0a2-579d-4a84-a34d-6a243a990982 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:24.794434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 830/1663] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:24 2022] PUT /identity/v3/projects/ebab2f978a6c415eb8e59b62665582e3/users/6cfc3bbcd29a4606a7ca8a2792b03f24/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:24.800222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:24.800803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:24.801224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b217c5f905674844b119f4ebda4e7bfe', 'request_id': 'req-27dfb3a4-1e02-4922-b053-0ab60584b2fb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.801918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:24.832966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b217c5f905674844b119f4ebda4e7bfe', 'request_id': 'req-27dfb3a4-1e02-4922-b053-0ab60584b2fb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.845317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b217c5f905674844b119f4ebda4e7bfe', 'request_id': 'req-27dfb3a4-1e02-4922-b053-0ab60584b2fb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.846555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:24.851278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:24.870886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] The token cache is being invalidate because project b217c5f905674844b119f4ebda4e7bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:24.871142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.871877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:24.877895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 834/1664] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:24 2022] DELETE /identity/v3/projects/b217c5f905674844b119f4ebda4e7bfe => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:24.878832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:24.884255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.013216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 831/1665] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:25.014173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:25.017584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.061901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bfe95-c955-4300-bf0d-589bc701b50b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:25.077566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:25.079699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.079979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.080919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] PATH_INFO: `/v3/users/557fdd30a45c440fab520ea5aabc9c2a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.083471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557fdd30a45c440fab520ea5aabc9c2a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:25.090013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:25.116939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfb3a4-1e02-4922-b053-0ab60584b2fb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:25.135137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:25.135808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.136100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.136383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.137095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:25.138794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:25.156661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 835/1666] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:25.156661 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:25.156882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.182332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58337-7b7f-41d5-be54-1842adb0e65e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:25.188705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:25.189554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.189891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.190177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] PATH_INFO: `/v3/users/89efe9625ac545a892adcd1d01d818a0` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.193002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89efe9625ac545a892adcd1d01d818a0)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:25.198208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:25.231732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557fdd30a45c440fab520ea5aabc9c2a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.242393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557fdd30a45c440fab520ea5aabc9c2a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.243124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557fdd30a45c440fab520ea5aabc9c2a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.243861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557fdd30a45c440fab520ea5aabc9c2a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.272608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-61019201-fd31-4992-8767-7683603a1574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557fdd30a45c440fab520ea5aabc9c2a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.314861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 832/1667] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:25 2022] DELETE /identity/v3/users/557fdd30a45c440fab520ea5aabc9c2a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:25.324759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89efe9625ac545a892adcd1d01d818a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.329052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e6a6-387d-42db-a07c-78cccb418c0b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.329450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e6a6-387d-42db-a07c-78cccb418c0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.336497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e6a6-387d-42db-a07c-78cccb418c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.357838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89efe9625ac545a892adcd1d01d818a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.360101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89efe9625ac545a892adcd1d01d818a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.361030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89efe9625ac545a892adcd1d01d818a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.389798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b8a4e6a6-387d-42db-a07c-78cccb418c0b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:25.393059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b8a4e6a6-387d-42db-a07c-78cccb418c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.407058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89efe9625ac545a892adcd1d01d818a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:25.434807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:25.440801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 836/1668] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:25 2022] DELETE /identity/v3/users/89efe9625ac545a892adcd1d01d818a0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:25.441859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:25.445771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.483736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:25.624413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 833/1669] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:25.628507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.630093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.631580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.640712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11b43-237a-410d-803d-478ce741b043 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:25.661563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933672-b99e-46f3-a227-2fb6c53d5b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:25.662755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933672-b99e-46f3-a227-2fb6c53d5b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.664793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933672-b99e-46f3-a227-2fb6c53d5b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.674347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933672-b99e-46f3-a227-2fb6c53d5b15 admin admin] PATH_INFO: `/v3/projects/ebab2f978a6c415eb8e59b62665582e3/users/6cfc3bbcd29a4606a7ca8a2792b03f24/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.681342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933672-b99e-46f3-a227-2fb6c53d5b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebab2f978a6c415eb8e59b62665582e3, user_id=6cfc3bbcd29a4606a7ca8a2792b03f24, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:25.695092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] MFA Rules not processed for user `7137e696c39443a7a1e5c6b92d74cec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:25.696476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.700004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933672-b99e-46f3-a227-2fb6c53d5b15 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:25.737242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 837/1670] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:25 2022] PUT /identity/v3/projects/ebab2f978a6c415eb8e59b62665582e3/users/6cfc3bbcd29a4606a7ca8a2792b03f24/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:25.737242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f38f-4a78-452d-96a9-9b4f4fd80b12 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:25.741807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f38f-4a78-452d-96a9-9b4f4fd80b12 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:25.741807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f38f-4a78-452d-96a9-9b4f4fd80b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:25.786450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6438f38f-4a78-452d-96a9-9b4f4fd80b12 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:25.788214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6438f38f-4a78-452d-96a9-9b4f4fd80b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:25.839656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 834/1671] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:25.840753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:25.865020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad640f-520b-477b-8180-3238cc13c5c1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:26.008104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:26.008811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:26.009094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:26.009410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:26.010167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:26.010475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:26.011112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 838/1672] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:26.012320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a227a-1c67-4a50-b28d-b4267ba2d5ca admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:26.012581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:26.012988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:26.013278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:26.043739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 835/1673] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:26.045413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:26.046086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:26.046795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:26.076191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] MFA Rules not processed for user `6cfc3bbcd29a4606a7ca8a2792b03f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:26.079378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.081931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] MFA Rules not processed for user `7137e696c39443a7a1e5c6b92d74cec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:26.083149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.193500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 839/1674] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:26.194554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:26.196513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.274909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:26.278272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213bae-480b-4710-87c0-65c1f859656e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:26.295759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:26.296639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:26.301358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:26.302612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] PATH_INFO: `/v3/projects/c1ed639f7bde4a7e8b6ea4ad9be18e18` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:26.309218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 836/1675] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:26.310202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ed639f7bde4a7e8b6ea4ad9be18e18)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:26.316315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:26.323400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.326891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:26.388448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:26.474252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7118f0-21a8-4d8e-85b8-79913e8ee990 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:26.482204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ed639f7bde4a7e8b6ea4ad9be18e18', 'request_id': 'req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:26.504212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ed639f7bde4a7e8b6ea4ad9be18e18', 'request_id': 'req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:26.523535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ed639f7bde4a7e8b6ea4ad9be18e18', 'request_id': 'req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:26.539575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] The token cache is being invalidate because project c1ed639f7bde4a7e8b6ea4ad9be18e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:26.539936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:26.546575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:26.548459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 840/1676] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:26 2022] DELETE /identity/v3/projects/c1ed639f7bde4a7e8b6ea4ad9be18e18 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:26.549428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:26.552077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.602824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:26.603529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:26.603820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:26.604100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:26.620316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.721781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bc0f4-dd89-43b8-9378-569b7bbc89e4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:26.739935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:26.740679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:26.741049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:26.741393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:26.742182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:26.745935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:26.772079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:26.778117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:26.812399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 841/1677] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:26 2022] POST /identity/v3/projects => generated 405 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:26.812399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:26.818388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.819364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 837/1678] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:26.821513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:26.825801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:26.972666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:26.994034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad867-e34c-4740-b334-a5d6520e7596 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:26.996366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3af74-0022-4298-9d1d-305e15cfdc98 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.012967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.013666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.013971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.014246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.016338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:27.129102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.129962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.130290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.130469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.136186 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:27.141441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:27.210200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.212932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1ab47-38d7-4610-b404-9fa1834c2f13 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.242364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 842/1679] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:27.249140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.249439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.249747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.264382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.267552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.285274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 838/1680] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:27.288208 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.314972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:27.319436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:27.441044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99255baa-36d6-43ff-a901-9199fa3a6fce service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.452505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206b4bc-1427-4d18-aa25-ac32773160f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.455383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206b4bc-1427-4d18-aa25-ac32773160f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.455672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206b4bc-1427-4d18-aa25-ac32773160f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.457282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206b4bc-1427-4d18-aa25-ac32773160f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.474207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206b4bc-1427-4d18-aa25-ac32773160f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.484246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206b4bc-1427-4d18-aa25-ac32773160f0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.501658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 843/1681] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:27.505857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.530311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09646d00-051d-4389-9b24-f5ca51281d73 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.546507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 839/1682] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:27 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:27.546646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.547711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.548002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.548278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.550029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.550311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.550588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.554664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:27.600077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:27.605270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:27.631574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 840/1683] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:27.633044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.660012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7102169-31aa-4b1c-9748-913a1de08818 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.673339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.677768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.678445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.679303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.680077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.680625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.681844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.688852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.698644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 844/1684] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:27.699518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.718244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe1a0f-7eb2-429b-9964-e0c222b4c048 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.728894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.729918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.730165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 841/1685] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:27.730269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.731697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.731937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.732674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:27.733516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.735363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.753467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 845/1686] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:27.761950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016dca-d504-4cff-9156-f97c9251d172 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.773429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.775564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.778561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.781133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.782276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.784641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.788627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.793880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf41faf-1993-46eb-b573-8139abd780ed admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.795242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:27.803109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.804004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.804818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.805392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.806274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.809265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.812108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 842/1687] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:27.822596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.859753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6686c8-1678-42bb-9e1d-2b2a96af2b7d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:27.879649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 846/1688] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:27 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:27.881381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:27.883369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fcc7a-22dc-4adb-a2ae-e2cf472f352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:27.883939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fcc7a-22dc-4adb-a2ae-e2cf472f352a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:27.884944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fcc7a-22dc-4adb-a2ae-e2cf472f352a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:27.884944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fcc7a-22dc-4adb-a2ae-e2cf472f352a admin admin] PATH_INFO: `/v3/projects/23ff319405914d0fbd617958c5b6eece/users/a530e461edf2476d9be131d62f2cebe3/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:27.947381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fcc7a-22dc-4adb-a2ae-e2cf472f352a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ff319405914d0fbd617958c5b6eece, user_id=a530e461edf2476d9be131d62f2cebe3, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:27.965297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fcc7a-22dc-4adb-a2ae-e2cf472f352a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:27.974493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:28.007977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb3ed-8543-497e-a45f-0e01d58d76e4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.014078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 843/1689] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:27 2022] PUT /identity/v3/projects/23ff319405914d0fbd617958c5b6eece/users/a530e461edf2476d9be131d62f2cebe3/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:28.029022 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1286-4403-4143-9af9-886e7343ceb1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.029326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1286-4403-4143-9af9-886e7343ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.029642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1286-4403-4143-9af9-886e7343ceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.119908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2d7b1286-4403-4143-9af9-886e7343ceb1 None None] MFA Rules not processed for user `a530e461edf2476d9be131d62f2cebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:28.120899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d7b1286-4403-4143-9af9-886e7343ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.140822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:28.141950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.142402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.142927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.143915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:28.146900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:28.199001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 847/1690] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:27 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:28.201569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:28.231096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6e2d-99d4-40f1-8017-1217e6700540 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.244046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:28.244807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.245111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.245664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.247251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:28.251623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:28.278929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 848/1691] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:28.279792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:28.283696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 844/1692] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:28.285357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.285947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.286354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.290093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.326680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833f43c-2632-4af7-b358-96147ffa69ec admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.344951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:28.346171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.346628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.346979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] PATH_INFO: `/v3/projects/5e9bbac0ad274e069d4a56d0747d34f6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.357417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9bbac0ad274e069d4a56d0747d34f6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:28.362453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:28.413744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] MFA Rules not processed for user `8990ee8f728f4dea9686b4819ee28fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:28.420982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.472127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9bbac0ad274e069d4a56d0747d34f6', 'request_id': 'req-e1674918-7dab-4610-bb4d-0fa67413304f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:28.480762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9bbac0ad274e069d4a56d0747d34f6', 'request_id': 'req-e1674918-7dab-4610-bb4d-0fa67413304f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:28.489900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9bbac0ad274e069d4a56d0747d34f6', 'request_id': 'req-e1674918-7dab-4610-bb4d-0fa67413304f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:28.507189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] The token cache is being invalidate because project 5e9bbac0ad274e069d4a56d0747d34f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:28.507812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:28.508494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:28.512968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 849/1693] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:28 2022] DELETE /identity/v3/projects/5e9bbac0ad274e069d4a56d0747d34f6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:28.515637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:28.519854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.624018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:28.626163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 845/1694] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:28.627086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:28.634370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.652500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674918-7dab-4610-bb4d-0fa67413304f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.660723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a540-73d3-4b04-b9cb-638421e5bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:28.661658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a540-73d3-4b04-b9cb-638421e5bf9f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.661963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a540-73d3-4b04-b9cb-638421e5bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.662580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a540-73d3-4b04-b9cb-638421e5bf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.663591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583a540-73d3-4b04-b9cb-638421e5bf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:28.665524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583a540-73d3-4b04-b9cb-638421e5bf9f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:28.671392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddc83-5a8d-4458-a3f6-8fc952244f51 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.679086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 850/1695] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:28.680768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.681068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.681352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.682916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:28.683566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.683853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.684194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.685051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:28.687608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:28.737749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:28.739089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.753788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 851/1696] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:28.754791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:28.761954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 846/1697] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:28 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:28.761954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:28.762745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:28.814658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:28.855195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ac01-7d3a-4731-aedc-b697307beb62 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.863040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:28.863963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:28.864243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:28.864517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] PATH_INFO: `/v3/projects/c8a326eda3144176ad1fd915282e472f/users/de7bfd950c60483ea58aee93f0328439/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:28.893826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a326eda3144176ad1fd915282e472f, user_id=de7bfd950c60483ea58aee93f0328439, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:28.897589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:28.910907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9e386-8c64-4e77-88dd-51021452c170 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:28.933980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 847/1698] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:28 2022] PUT /identity/v3/projects/c8a326eda3144176ad1fd915282e472f/users/de7bfd950c60483ea58aee93f0328439/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:28.933980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.028383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddb224-e208-4430-a24b-878efd96b5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:29.029039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddb224-e208-4430-a24b-878efd96b5bb service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.030129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddb224-e208-4430-a24b-878efd96b5bb service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.030129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddb224-e208-4430-a24b-878efd96b5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.043797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ed36-bde7-47c1-87dd-c163a2a6b24f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:29.052085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02932-8d98-45dc-abfb-051bc65e8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:29.053095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02932-8d98-45dc-abfb-051bc65e8629 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.053680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02932-8d98-45dc-abfb-051bc65e8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.054842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02932-8d98-45dc-abfb-051bc65e8629 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.056198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02932-8d98-45dc-abfb-051bc65e8629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:29.059172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02932-8d98-45dc-abfb-051bc65e8629 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:29.089370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 848/1699] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:28 2022] POST /identity/v3/users => generated 309 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:29.091394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094e03-620b-4861-b9aa-efaecfee726b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.092112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094e03-620b-4861-b9aa-efaecfee726b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.092541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094e03-620b-4861-b9aa-efaecfee726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.111665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddb224-e208-4430-a24b-878efd96b5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:29.115826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddb224-e208-4430-a24b-878efd96b5bb service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:29.125680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ee094e03-620b-4861-b9aa-efaecfee726b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:29.127449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee094e03-620b-4861-b9aa-efaecfee726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.128674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 852/1700] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:29.130220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.130645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.130978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.149765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 849/1701] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:29.153147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88fb86-dbb3-4128-988a-12af4bacb417 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.155041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88fb86-dbb3-4128-988a-12af4bacb417 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.157037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88fb86-dbb3-4128-988a-12af4bacb417 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.162611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 850/1702] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 29 04:43:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:43:29.163946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.165801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.166720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.195067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] MFA Rules not processed for user `b2e41aeff8cd43a1ae221b6cbfce2dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:29.209814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.214070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:29.235464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] MFA Rules not processed for user `de7bfd950c60483ea58aee93f0328439`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:29.236940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.324144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 853/1703] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:29.325093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.335171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 851/1704] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:29.336322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.342136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f1982-39f8-4477-b672-1c2857403d65 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:29.349556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a2b24-95b8-4ee2-b45a-4e9cbfba969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:29.350532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2b24-95b8-4ee2-b45a-4e9cbfba969f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.350818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2b24-95b8-4ee2-b45a-4e9cbfba969f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.352136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2b24-95b8-4ee2-b45a-4e9cbfba969f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.352921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a2b24-95b8-4ee2-b45a-4e9cbfba969f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:29.353491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196b08-5a23-4c2d-8d25-188126fa4872 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:29.354890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a2b24-95b8-4ee2-b45a-4e9cbfba969f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:29.360130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:29.360843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.361267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.362221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.363263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:29.363369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:29.365813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88d7f5-a5b4-414b-b800-a537729842ca admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:29.371831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 854/1705] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:29.374714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.375532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.376025 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.388415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 852/1706] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:29.390172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2993-01c5-4f49-bcf9-0331e31c2988 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.390331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2993-01c5-4f49-bcf9-0331e31c2988 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.391783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2993-01c5-4f49-bcf9-0331e31c2988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.435095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-da2f2993-01c5-4f49-bcf9-0331e31c2988 None None] MFA Rules not processed for user `3cf68e097d3941218efae9a5ef5bba12`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:29.438411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da2f2993-01c5-4f49-bcf9-0331e31c2988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.454573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:29.456748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:29.457679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.556562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 853/1707] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:29.556562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.556562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.556562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.595849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 855/1708] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:29.596804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.630248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa481-dfb1-4801-ba5b-984012f5df24 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:29.635979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] MFA Rules not processed for user `b2e41aeff8cd43a1ae221b6cbfce2dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:29.649269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:29.649736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.650026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.650309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.650988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.651100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:29.652920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:29.672700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 854/1709] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:29.675237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.700690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa04db-8d97-4afa-b80a-af3e6d30d48e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:29.722861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:29.723706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:29.724016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:29.724318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] PATH_INFO: `/v3/projects/8fd1bd6808304f5199e68cf4867e53c3/users/852b4784f0e6491da372c37dfb1431b0/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:29.728365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 856/1710] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:29.732643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.771713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1bd6808304f5199e68cf4867e53c3, user_id=852b4784f0e6491da372c37dfb1431b0, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:29.778097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:29.796623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 855/1711] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:29 2022] PUT /identity/v3/projects/8fd1bd6808304f5199e68cf4867e53c3/users/852b4784f0e6491da372c37dfb1431b0/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:29.797622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:29.805850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:29.988356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309091-8871-4051-9117-972fc43a7042 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.006287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5db054-5313-44bc-a74c-60ffa01bab40 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.013242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.013883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.014080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.014499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.027472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:30.035482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.036903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.066478 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 856/1712] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:30.068007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.136098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.136858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.137184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.137470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.138721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.153224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.228383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 857/1713] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:29 2022] POST /identity/v3/projects => generated 365 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:30.232196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.244711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672d74b-bade-4031-8cac-99957fa607ef service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.325629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:30.386551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.387298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.387803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.388120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.388813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.391314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.392374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5722-a7bc-4521-9537-b6bbcff96715 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.429454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.432386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.433100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.434342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.436253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.436892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 857/1714] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:30 2022] POST /identity/v3/users => generated 300 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:30.437778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.438918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.459210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da19d91-05c3-4bf4-9c13-93d4b1221caa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.471785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.472437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.472715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.472994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.473708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.475630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.479719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 858/1715] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:30.481145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.508947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705073e5-0037-4a55-83f2-bc7f1bbdc554 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.522492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 858/1716] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:30 2022] POST /identity/v3/users => generated 283 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:30.523338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.537788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.538547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.538886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.540627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.541572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.544651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.551297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f917-e8a6-4152-ac50-376565c28a51 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.565287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 859/1717] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:30.565287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.572431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.573272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.573691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.573878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] PATH_INFO: `/v3/projects/8fd1bd6808304f5199e68cf4867e53c3/users/852b4784f0e6491da372c37dfb1431b0/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.579715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1bd6808304f5199e68cf4867e53c3, user_id=852b4784f0e6491da372c37dfb1431b0, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.583372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.598802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06587-1243-4c72-a8a2-4e20d9624e68 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.617773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 859/1718] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:30 2022] PUT /identity/v3/projects/8fd1bd6808304f5199e68cf4867e53c3/users/852b4784f0e6491da372c37dfb1431b0/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:30.617773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.650478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83332164-3cea-4c1c-9977-429515c97920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.652139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332164-3cea-4c1c-9977-429515c97920 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.653099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332164-3cea-4c1c-9977-429515c97920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.653462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332164-3cea-4c1c-9977-429515c97920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.655755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83332164-3cea-4c1c-9977-429515c97920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.661053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83332164-3cea-4c1c-9977-429515c97920 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.683152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 860/1719] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:30.684734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.685029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.685310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.751924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] MFA Rules not processed for user `852b4784f0e6491da372c37dfb1431b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:30.753253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:30.790138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823fd3-46a1-47ca-93d2-02df47378cf6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:30.803485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59351-e5a8-4dda-a725-f6ff85a14194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:30.804351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59351-e5a8-4dda-a725-f6ff85a14194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.811506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59351-e5a8-4dda-a725-f6ff85a14194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.811905 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59351-e5a8-4dda-a725-f6ff85a14194 admin admin] PATH_INFO: `/v3/projects/57e7dfe585594921a54fc3c03b7d4695/users/fe4d595f83b5413fa202eade0cf0ecbf/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.846463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59351-e5a8-4dda-a725-f6ff85a14194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e7dfe585594921a54fc3c03b7d4695, user_id=fe4d595f83b5413fa202eade0cf0ecbf, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:30.849391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59351-e5a8-4dda-a725-f6ff85a14194 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:30.876009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 860/1720] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:30 2022] PUT /identity/v3/projects/57e7dfe585594921a54fc3c03b7d4695/users/fe4d595f83b5413fa202eade0cf0ecbf/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:30.877891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56a9c-7982-4bef-ae42-d136ec0554d2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:30.878401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56a9c-7982-4bef-ae42-d136ec0554d2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:30.879389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56a9c-7982-4bef-ae42-d136ec0554d2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:30.881165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 861/1721] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 29 04:43:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:43:30.882018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e56a9c-7982-4bef-ae42-d136ec0554d2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.902273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:30.911948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 861/1722] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:30.913547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:30.932819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63746d96-acd2-45e1-bffc-a12d6642112e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:31.012195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e56a9c-7982-4bef-ae42-d136ec0554d2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:31.030650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f1efc-ec63-450e-8412-f152d3f50262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:31.031823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1efc-ec63-450e-8412-f152d3f50262 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.032108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1efc-ec63-450e-8412-f152d3f50262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.033488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1efc-ec63-450e-8412-f152d3f50262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.035366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f1efc-ec63-450e-8412-f152d3f50262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:31.041497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f1efc-ec63-450e-8412-f152d3f50262 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:31.076272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 862/1723] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:31.077417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.077758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.078115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.112502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:31.114280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.116983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.117359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.118424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:31.122405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:31.146695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:31.149868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:31.172898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:31.179392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 862/1724] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:31.184346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:31.193005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:31.337331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 863/1725] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:31.338403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:31.363756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372a1d-804f-44bc-99b7-717697e3c1c7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:31.374267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:31.375262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.375543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.375943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] PATH_INFO: `/v3/projects/28250e635d6842e2bf55f4524ac7d09e/users/eea9e83eba6346b7b791ea37c4f37671/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.397789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28250e635d6842e2bf55f4524ac7d09e, user_id=eea9e83eba6346b7b791ea37c4f37671, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:31.400435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a06f3-adf5-48bd-a211-da890f40e858 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:31.400972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:31.411470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:31.411763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.412068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.412380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.434518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 864/1726] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:31 2022] PUT /identity/v3/projects/28250e635d6842e2bf55f4524ac7d09e/users/eea9e83eba6346b7b791ea37c4f37671/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:31.435936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:31.545970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a44bb1-5189-495e-af9f-6882ce6ffa72 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:31.561104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b4523-38f1-43e7-aff5-d5a58a32042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:31.561393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b4523-38f1-43e7-aff5-d5a58a32042f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.561654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b4523-38f1-43e7-aff5-d5a58a32042f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.561936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b4523-38f1-43e7-aff5-d5a58a32042f admin admin] PATH_INFO: `/v3/projects/57e7dfe585594921a54fc3c03b7d4695/users/fe4d595f83b5413fa202eade0cf0ecbf/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.568329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b4523-38f1-43e7-aff5-d5a58a32042f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e7dfe585594921a54fc3c03b7d4695, user_id=fe4d595f83b5413fa202eade0cf0ecbf, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:31.570627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:31.572103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:31.576396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b4523-38f1-43e7-aff5-d5a58a32042f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:31.611264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 863/1727] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:31 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:31.612403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:31.618893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:31.623790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 865/1728] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:31 2022] PUT /identity/v3/projects/57e7dfe585594921a54fc3c03b7d4695/users/fe4d595f83b5413fa202eade0cf0ecbf/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:31.626313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.626724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.627006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.673703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] MFA Rules not processed for user `eea9e83eba6346b7b791ea37c4f37671`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:31.675426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:31.680756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be292f-7bf6-4b48-811a-a5cd78bf8e58 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:31.782145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 866/1729] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:31.783142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:31.787806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:31.843295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:31.854943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3060d0-5421-4377-bd6a-3a5b5b0020fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:31.856194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3060d0-5421-4377-bd6a-3a5b5b0020fd service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.856615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3060d0-5421-4377-bd6a-3a5b5b0020fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.857076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3060d0-5421-4377-bd6a-3a5b5b0020fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.862948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:31.876527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3060d0-5421-4377-bd6a-3a5b5b0020fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:31.878367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3060d0-5421-4377-bd6a-3a5b5b0020fd service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:31.897687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 864/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:31.898936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1551-d795-4922-9fca-0812398f849f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:31.899229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1551-d795-4922-9fca-0812398f849f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:31.904222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1551-d795-4922-9fca-0812398f849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:31.980675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2abb1551-d795-4922-9fca-0812398f849f None None] MFA Rules not processed for user `fe4d595f83b5413fa202eade0cf0ecbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:31.981965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2abb1551-d795-4922-9fca-0812398f849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:32.084532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561454d-414c-4c10-b8b8-0a666ab4a55e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:32.100772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:32.103325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.107249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.107723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.189966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 865/1731] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:32.191314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904a7c-3ff9-4fe1-a151-1317f25cc4b3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.191605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904a7c-3ff9-4fe1-a151-1317f25cc4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.191881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904a7c-3ff9-4fe1-a151-1317f25cc4b3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.193131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 866/1732] 10.222.0.46 () {54 vars in 961 bytes} [Fri Jul 29 04:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:43:32.199747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904a7c-3ff9-4fe1-a151-1317f25cc4b3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:32.294689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:32.296346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:32.323306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 867/1733] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:32.324203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:32.355337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904a7c-3ff9-4fe1-a151-1317f25cc4b3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:32.363392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:32.364116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.364547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.364650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.365333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:32.367374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:32.473749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12613ebb-48e0-4833-afc9-bf5a3bf66dba service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:32.481042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 867/1734] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:32 2022] POST /identity/v3/projects => generated 363 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:32.482274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:32.486270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:32.492886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:32.494466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.503634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.504068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] PATH_INFO: `/v3/users/a530e461edf2476d9be131d62f2cebe3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.505609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a530e461edf2476d9be131d62f2cebe3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:32.510765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:32.623451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133a3a-de71-4301-88da-b49933e0c426 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:32.634230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:32.634429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.635208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.635208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.671726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a530e461edf2476d9be131d62f2cebe3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:32.677699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:32.699086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a530e461edf2476d9be131d62f2cebe3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:32.701426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a530e461edf2476d9be131d62f2cebe3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:32.702258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a530e461edf2476d9be131d62f2cebe3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:32.721176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:32.743687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-58abce5d-9c46-4c02-bb94-c54e1b8f50c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a530e461edf2476d9be131d62f2cebe3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:32.766750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 868/1735] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:32 2022] DELETE /identity/v3/users/a530e461edf2476d9be131d62f2cebe3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:32.768231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe4504-269a-4a50-ba6c-38f97b6c58a7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.768628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe4504-269a-4a50-ba6c-38f97b6c58a7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.769013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe4504-269a-4a50-ba6c-38f97b6c58a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.785110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:32.786593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:32.808558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-41fe4504-269a-4a50-ba6c-38f97b6c58a7 None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:32.808781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 868/1736] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:32.809714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:32.810065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-41fe4504-269a-4a50-ba6c-38f97b6c58a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:32.912633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 869/1737] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Jul 29 04:43:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:32.914345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:32.914735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:32.915114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:32.945936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:32.947265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.031630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 870/1738] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:33.032643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.037119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.063751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0012542-4b9f-4d9c-a738-c896ed165ee3 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.073399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.075716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.076187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.076615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.077456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:33.077772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9cc6e-09eb-490c-a558-bcaa7387d144 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.083061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:33.088534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.094739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.095176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.095571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] PATH_INFO: `/v3/users/de7bfd950c60483ea58aee93f0328439` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.098862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7bfd950c60483ea58aee93f0328439)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:33.100009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:33.149039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 869/1739] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:32 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:33.165246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.211199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa0a2-6091-4431-a4f1-2c83dfd238b3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.229785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.232941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.233390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.233877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.241803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.265250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7bfd950c60483ea58aee93f0328439'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:33.265385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:33.269536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:33.285095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7bfd950c60483ea58aee93f0328439'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:33.285985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7bfd950c60483ea58aee93f0328439'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:33.287632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7bfd950c60483ea58aee93f0328439'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:33.305157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 870/1740] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:33.306413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.308631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:33.309447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.315981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7bfd950c60483ea58aee93f0328439'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:33.358843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 871/1741] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:33 2022] DELETE /identity/v3/users/de7bfd950c60483ea58aee93f0328439 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:33.360782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.367658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.367836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fcb75-ab71-45df-b375-de356795776f service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.486381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30968-442a-471f-bc83-58099611e522 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.490287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.491240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.491675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.492120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.494377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.497257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.498239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.498530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.499118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.507624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.513973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:33.516345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:33.554269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 871/1742] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:33.555204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.558295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.625895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:33.627655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcb192-9299-4f07-a16b-671a0827a05c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:33.633493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:33.652869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 872/1743] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:33.657315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30847b1-2d00-4c58-9399-18f8e08834e4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.657633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30847b1-2d00-4c58-9399-18f8e08834e4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.661715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30847b1-2d00-4c58-9399-18f8e08834e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.715161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f30847b1-2d00-4c58-9399-18f8e08834e4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:33.718226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f30847b1-2d00-4c58-9399-18f8e08834e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.739199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 873/1744] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:33.756385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.756674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.756959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.802903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6940a-6c48-48da-af7c-ea340138eb33 service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.811694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] MFA Rules not processed for user `8990ee8f728f4dea9686b4819ee28fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:33.818382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:33.830044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.830935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.831285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.832551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.835297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:33.839112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:33.863977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 872/1745] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:33.864872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.907528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002e4a0-6996-46b0-9829-76c885e1390e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:33.927884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:33.940246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:33.940606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:33.940892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:33.971386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 874/1746] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:33.972293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:33.995884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:34.000855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:34.002752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a261e-49ae-46cc-8635-835caa719d47 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:34.028532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:34.029465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:34.029816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:34.030100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] PATH_INFO: `/v3/projects/6b64da83f81b414a9d82c1a3abdc1557/users/bb8ca026110541d2873619be4bb8f93b/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:34.050878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 873/1747] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:34.066771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b64da83f81b414a9d82c1a3abdc1557, user_id=bb8ca026110541d2873619be4bb8f93b, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:34.073768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:34.105343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 875/1748] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:33 2022] PUT /identity/v3/projects/6b64da83f81b414a9d82c1a3abdc1557/users/bb8ca026110541d2873619be4bb8f93b/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:34.106932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:34.157042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd44e-32d1-496f-989e-263a89f6db29 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:34.363638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f076a0-09ea-4c97-9647-1b58761cdf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:34.365939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f076a0-09ea-4c97-9647-1b58761cdf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:34.367761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f076a0-09ea-4c97-9647-1b58761cdf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:34.368052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f076a0-09ea-4c97-9647-1b58761cdf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:34.371206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f076a0-09ea-4c97-9647-1b58761cdf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:34.377261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f076a0-09ea-4c97-9647-1b58761cdf3c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:34.416666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 874/1749] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:34.420892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:34.449263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c087a7-af84-492d-81a9-f790d6302c9f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:34.457005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:34.458217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:34.458726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:34.458926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] PATH_INFO: `/v3/projects/6b64da83f81b414a9d82c1a3abdc1557/users/bb8ca026110541d2873619be4bb8f93b/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:34.462754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b64da83f81b414a9d82c1a3abdc1557, user_id=bb8ca026110541d2873619be4bb8f93b, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:34.466921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:34.498060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:34.536409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 876/1750] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:34 2022] PUT /identity/v3/projects/6b64da83f81b414a9d82c1a3abdc1557/users/bb8ca026110541d2873619be4bb8f93b/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:34.546650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:34.546943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:34.547240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:34.699539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] MFA Rules not processed for user `bb8ca026110541d2873619be4bb8f93b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:34.708469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:34.889293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:34.891702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:34.952253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 875/1751] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:34.962969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:34.966813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:35.075785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:35.235685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3030-8967-4a27-8611-a5e0a5ceb994 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:35.256539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:35.259143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:35.261014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:35.263020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] PATH_INFO: `/v3/projects/23ff319405914d0fbd617958c5b6eece` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:35.269265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ff319405914d0fbd617958c5b6eece)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:35.273835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b928-9b2e-4b8a-943b-285a5af98ceb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:35.278487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:35.291282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b1498-fe24-4c5d-95e3-388ebd47c42d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:35.294392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1498-fe24-4c5d-95e3-388ebd47c42d service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:35.296268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1498-fe24-4c5d-95e3-388ebd47c42d service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:35.297264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1498-fe24-4c5d-95e3-388ebd47c42d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:35.339602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b1498-fe24-4c5d-95e3-388ebd47c42d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:35.343017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b1498-fe24-4c5d-95e3-388ebd47c42d service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:35.384875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 876/1752] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:35.479493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ff319405914d0fbd617958c5b6eece', 'request_id': 'req-13170b57-481d-4983-b670-7ef6d95d6f68'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:35.483453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:35.484173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:35.484897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:35.519190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ff319405914d0fbd617958c5b6eece', 'request_id': 'req-13170b57-481d-4983-b670-7ef6d95d6f68'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:35.540941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ff319405914d0fbd617958c5b6eece', 'request_id': 'req-13170b57-481d-4983-b670-7ef6d95d6f68'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:35.541759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] MFA Rules not processed for user `b2e41aeff8cd43a1ae221b6cbfce2dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:35.543277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:35.574133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] The token cache is being invalidate because project 23ff319405914d0fbd617958c5b6eece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:35.574679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:35.576297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:35.581498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 877/1753] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:34 2022] DELETE /identity/v3/projects/23ff319405914d0fbd617958c5b6eece => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:35.584288 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:35.589857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:35.732535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 877/1754] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:35.745403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13170b57-481d-4983-b670-7ef6d95d6f68 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:35.754016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:35.755642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:35.756409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:35.756804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:35.757310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:35.761650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:35.763426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:35.880216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:35.915607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:35.921247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:35.970345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 878/1755] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:35.978568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:35.982956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:36.023512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa087-2007-4584-a4b7-2162f59e383f service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:36.029423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb926-b38a-4862-bfcf-59e756c502a3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:36.046203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:36.047152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:36.048967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:36.050643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] PATH_INFO: `/v3/users/852b4784f0e6491da372c37dfb1431b0` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:36.052399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852b4784f0e6491da372c37dfb1431b0)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:36.059085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:36.068946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:36.069257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:36.069550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:36.069967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] PATH_INFO: `/v3/projects/c8a326eda3144176ad1fd915282e472f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:36.071925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a326eda3144176ad1fd915282e472f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:36.074246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:36.184510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852b4784f0e6491da372c37dfb1431b0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.200824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852b4784f0e6491da372c37dfb1431b0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.202323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852b4784f0e6491da372c37dfb1431b0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.204315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852b4784f0e6491da372c37dfb1431b0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.211788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a326eda3144176ad1fd915282e472f', 'request_id': 'req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.231734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a326eda3144176ad1fd915282e472f', 'request_id': 'req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.246342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:36.260649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852b4784f0e6491da372c37dfb1431b0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.275439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a326eda3144176ad1fd915282e472f', 'request_id': 'req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.283058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 878/1756] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:35 2022] DELETE /identity/v3/users/852b4784f0e6491da372c37dfb1431b0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:36.334571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] The token cache is being invalidate because project c8a326eda3144176ad1fd915282e472f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:36.334871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.336771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.346871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 879/1757] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:35 2022] DELETE /identity/v3/projects/c8a326eda3144176ad1fd915282e472f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:36.348286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:36.350541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:36.451057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f22598-eb7d-4429-b824-a385b897c2a3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:36.468529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:36.473327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:36.474024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:36.474383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] PATH_INFO: `/v3/users/fe4d595f83b5413fa202eade0cf0ecbf` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:36.477254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4d595f83b5413fa202eade0cf0ecbf)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:36.484982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:36.621109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4d595f83b5413fa202eade0cf0ecbf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.653562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4d595f83b5413fa202eade0cf0ecbf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.654639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4d595f83b5413fa202eade0cf0ecbf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.656509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4d595f83b5413fa202eade0cf0ecbf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.686452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-35b725b1-5f2e-4880-bfff-99dec850e66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4d595f83b5413fa202eade0cf0ecbf'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:36.720156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:36.721786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:36.736203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 879/1758] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:36 2022] DELETE /identity/v3/users/fe4d595f83b5413fa202eade0cf0ecbf => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:36.875169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fe6d-08b2-4a20-bbd4-909fb1bcf656 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:37.011220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:37.011867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:37.012224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:37.012574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] PATH_INFO: `/v3/users/8034a83f4ac64a7b8f43bff6eb0808bd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:37.016009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8034a83f4ac64a7b8f43bff6eb0808bd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:37.018858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:37.064263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:37.171403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8034a83f4ac64a7b8f43bff6eb0808bd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:37.186203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8034a83f4ac64a7b8f43bff6eb0808bd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:37.190158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8034a83f4ac64a7b8f43bff6eb0808bd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:37.191653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8034a83f4ac64a7b8f43bff6eb0808bd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:37.225918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8034a83f4ac64a7b8f43bff6eb0808bd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:37.261335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 880/1759] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:36 2022] DELETE /identity/v3/users/8034a83f4ac64a7b8f43bff6eb0808bd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:37.263120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:37.263505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:37.263857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:37.322325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:37.323668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:37.489722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 880/1760] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:37.586592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:37.588267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:37.629154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:37.630759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:37.663978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332227ed-8131-4650-8f07-3a5b63c6f860 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:37.681781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:37.682441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:37.682898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:37.683331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] PATH_INFO: `/v3/projects/8fd1bd6808304f5199e68cf4867e53c3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:37.686514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd1bd6808304f5199e68cf4867e53c3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:37.691312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:37.695930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:37.830380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a397a1a-476a-4ba7-954c-0b8b9e54ab8f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:37.856912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf58e6-af70-4c7f-b619-cd81adbd5bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:37.857576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf58e6-af70-4c7f-b619-cd81adbd5bad service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:37.857887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf58e6-af70-4c7f-b619-cd81adbd5bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:37.858169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf58e6-af70-4c7f-b619-cd81adbd5bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:37.896743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf58e6-af70-4c7f-b619-cd81adbd5bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:37.898665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf58e6-af70-4c7f-b619-cd81adbd5bad service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:37.973887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 881/1761] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:38.012967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:38.013583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:38.014113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:38.035228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd1bd6808304f5199e68cf4867e53c3', 'request_id': 'req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:38.064643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd1bd6808304f5199e68cf4867e53c3', 'request_id': 'req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:38.104736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd1bd6808304f5199e68cf4867e53c3', 'request_id': 'req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:38.144245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] The token cache is being invalidate because project 8fd1bd6808304f5199e68cf4867e53c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:38.147731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:38.150471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4ee9ff5d-381b-47e9-b0d2-ad33d41e88e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:38.162443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 881/1762] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:37 2022] DELETE /identity/v3/projects/8fd1bd6808304f5199e68cf4867e53c3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:43:38.166847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336cb0-72dd-449c-9b8d-e260523f2db0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:38.168838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336cb0-72dd-449c-9b8d-e260523f2db0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:38.169283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55336cb0-72dd-449c-9b8d-e260523f2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:38.219220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:38.222532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:38.244054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-55336cb0-72dd-449c-9b8d-e260523f2db0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:38.246373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-55336cb0-72dd-449c-9b8d-e260523f2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:38.412947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 882/1763] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:38.422518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:38.422814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:38.423094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:38.423194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 882/1764] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 29 04:43:38.518197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:38.519442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:38.558138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 883/1765] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:38.559893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:38.594299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea978d5-5144-45bb-aedb-dc02f8a81d92 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:38.617689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:38.618594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:38.619079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:38.619768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:38.620793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:38.621488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:38.625664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:38.629344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:38.641455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 883/1766] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:38.647755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:38.660711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d5d3d-f243-4f8b-9228-eec51e8563cb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:38.674587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:38.675107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:38.675589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:38.676056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:38.677315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:38.679639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:38.771888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:38.785213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175d513-b4b9-4b56-a401-934a4ee834c2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:38.785448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 884/1767] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:38 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:38.788334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:38.792124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:39.019307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.021124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.021430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.021744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.022447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:39.035259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:39.047937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:39.111675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 884/1768] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:38 2022] POST /identity/v3/users => generated 278 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:39.112620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:39.116417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:39.139590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041030-ea42-4dbb-bc14-6465327389da admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:39.141027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6f27-8565-4088-bb19-d09aa69c5fce admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:39.150300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.151281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.152105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.152929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.153382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.153829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.154268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.154690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] PATH_INFO: `/v3/projects/57e7dfe585594921a54fc3c03b7d4695` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.158373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e7dfe585594921a54fc3c03b7d4695)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:39.160947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:39.322400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e7dfe585594921a54fc3c03b7d4695', 'request_id': 'req-4a31c4db-7d63-4949-a139-f1cec113fa7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:39.340034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:39.341786 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:39.349354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e7dfe585594921a54fc3c03b7d4695', 'request_id': 'req-4a31c4db-7d63-4949-a139-f1cec113fa7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:39.372657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e7dfe585594921a54fc3c03b7d4695', 'request_id': 'req-4a31c4db-7d63-4949-a139-f1cec113fa7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:39.378654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 885/1769] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:43:39.382082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:39.400300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] The token cache is being invalidate because project 57e7dfe585594921a54fc3c03b7d4695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:39.400891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:39.403358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4a31c4db-7d63-4949-a139-f1cec113fa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:39.407677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 885/1770] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:39 2022] DELETE /identity/v3/projects/57e7dfe585594921a54fc3c03b7d4695 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:39.409064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075750ee-9da0-47e2-8353-3b849b8497e8 service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:39.412505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d410-c2f3-4ca3-8cc4-98d7af4476a4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.412605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d410-c2f3-4ca3-8cc4-98d7af4476a4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.412952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d410-c2f3-4ca3-8cc4-98d7af4476a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.469518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7b29d410-c2f3-4ca3-8cc4-98d7af4476a4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:39.476382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b29d410-c2f3-4ca3-8cc4-98d7af4476a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:39.581008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.581916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.582183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.582559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.583390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:39.585122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:39.632543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 886/1771] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:39.639672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:39.645038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:39.707433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 886/1772] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:39.715291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.717362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.717881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.721642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a9036-5edf-48aa-b60a-bf4dc977323d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:39.747258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.751735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.753824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.754121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.758966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:39.761885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:39.811699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 887/1773] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:39.816402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:39.836260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:39.844590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:39.858230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda8b0-a549-40a2-818a-28f47d72e45d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:39.878293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 887/1774] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:39.882192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:39.886333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.887794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.889564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:39.894141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.896172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] PATH_INFO: `/v3/projects/b7c0ff4e7941483c9366710fac7d1a57/users/f473a1d25c7049e1b4ba067e9b08fb5e/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.907321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658efa7-c8d3-483a-bcb9-71e986c8e185 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:39.933734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:39.934792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:39.938297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:39.938879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:39.939830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:39.940372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:39.943119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:40.007604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 888/1775] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:43:40.008743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:40.040256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:40.048027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0ff4e7941483c9366710fac7d1a57, user_id=f473a1d25c7049e1b4ba067e9b08fb5e, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:40.059161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:40.096897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 888/1776] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:39 2022] PUT /identity/v3/projects/b7c0ff4e7941483c9366710fac7d1a57/users/f473a1d25c7049e1b4ba067e9b08fb5e/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:40.099666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:40.102711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2420827-9081-461a-8371-7c998807b3a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:40.285433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:40.381724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:40.383684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:40.383972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:40.384257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] PATH_INFO: `/v3/users/eea9e83eba6346b7b791ea37c4f37671` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:40.390861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea9e83eba6346b7b791ea37c4f37671)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:40.400399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:40.402728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c507b61-0e19-4ed8-9379-f5e4d6e68d85 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:40.451020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9471f2-17a5-4650-9912-0dc02fc4846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:40.454459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9471f2-17a5-4650-9912-0dc02fc4846d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:40.454944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9471f2-17a5-4650-9912-0dc02fc4846d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:40.455446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9471f2-17a5-4650-9912-0dc02fc4846d admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:40.462070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9471f2-17a5-4650-9912-0dc02fc4846d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:40.469424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9471f2-17a5-4650-9912-0dc02fc4846d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:40.579821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 889/1777] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:40 2022] POST /identity/v3/projects => generated 387 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:40.588853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e714-765f-4583-b00f-a157ed0b1ade None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:40.589087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e714-765f-4583-b00f-a157ed0b1ade None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:40.589865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e714-765f-4583-b00f-a157ed0b1ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:40.597807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea9e83eba6346b7b791ea37c4f37671'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:40.624502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea9e83eba6346b7b791ea37c4f37671'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:40.627625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea9e83eba6346b7b791ea37c4f37671'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:40.630102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea9e83eba6346b7b791ea37c4f37671'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:40.676008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea9e83eba6346b7b791ea37c4f37671'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:40.697571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4377e714-765f-4583-b00f-a157ed0b1ade None None] MFA Rules not processed for user `f473a1d25c7049e1b4ba067e9b08fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:40.699391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4377e714-765f-4583-b00f-a157ed0b1ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:40.750393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 889/1778] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:40 2022] DELETE /identity/v3/users/eea9e83eba6346b7b791ea37c4f37671 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:40.750393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:40.753035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:40.983641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 890/1779] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:40.986285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:40.986729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:40.987158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:41.051267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:41.066495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:41.105160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 891/1780] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:41.106182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:41.109838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:41.125795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5c70a-9b3f-47aa-8045-5b929eb22b48 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:41.144218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:41.144867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:41.149251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:41.149916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:41.152345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:41.158651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a198c-cf95-4899-8b7c-9c80948c3689 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:41.162130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:41.177559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:41.178545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:41.178885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:41.179354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:41.180398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:41.182902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:41.224200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:41.251304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 890/1781] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:40 2022] POST /identity/v3/users => generated 294 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:41.257147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:41.264673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 892/1782] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:41 2022] POST /identity/v3/projects => generated 355 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:41.266242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:41.273673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:41.274540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:41.327045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd49891-0ceb-4c60-9937-40ad7e83e4f3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:41.493105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d7e30-f082-4641-9d69-e9d950100967 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:41.502754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:41.505251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:41.505633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:41.507544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:41.555078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:41.557456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:41.558495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:41.558780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] PATH_INFO: `/v3/projects/fc71c837ce4f420dae876bec51adef3e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:41.575129 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc71c837ce4f420dae876bec51adef3e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:41.581460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:41.634043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:41.685363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:41.690657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:41.721979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 893/1783] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:41.723255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:41.751991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed27225-a22e-4823-b794-f390fe8eabf2 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:41.768138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc71c837ce4f420dae876bec51adef3e', 'request_id': 'req-a79daae1-cf57-4dee-9b20-3d444747f469'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:41.790325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc71c837ce4f420dae876bec51adef3e', 'request_id': 'req-a79daae1-cf57-4dee-9b20-3d444747f469'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:41.829449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc71c837ce4f420dae876bec51adef3e', 'request_id': 'req-a79daae1-cf57-4dee-9b20-3d444747f469'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:41.869184 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] The token cache is being invalidate because project fc71c837ce4f420dae876bec51adef3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:41.870287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:41.871930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:41.877039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 891/1784] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:41 2022] DELETE /identity/v3/projects/fc71c837ce4f420dae876bec51adef3e => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:41.879620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:41.882818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:41.934922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:41.935584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:41.935873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:41.936153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:41.938918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:41.940531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:41.983654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 894/1785] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:41.984689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:41.997111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:42.038237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f197-74ea-4c0a-813c-061eb8d5eea1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:42.063589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:42.064302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.064562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.064819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] PATH_INFO: `/v3/users/6cfc3bbcd29a4606a7ca8a2792b03f24` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.067930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfc3bbcd29a4606a7ca8a2792b03f24)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:42.070861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:42.128329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daae1-cf57-4dee-9b20-3d444747f469 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:42.153562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:42.158227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.158429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.162021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.164895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:42.170434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:42.223227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfc3bbcd29a4606a7ca8a2792b03f24'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:42.260572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 892/1786] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:41 2022] POST /identity/v3/users => generated 284 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:42.263926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:42.266351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfc3bbcd29a4606a7ca8a2792b03f24'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:42.272608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:42.272820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfc3bbcd29a4606a7ca8a2792b03f24'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:42.274883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfc3bbcd29a4606a7ca8a2792b03f24'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:42.340139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccb10d-6dcb-4d02-9c20-ad364398dbef admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:42.351830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfc3bbcd29a4606a7ca8a2792b03f24'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:42.372028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd97f98-49d3-4abf-b932-b4d986671f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:42.373648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd97f98-49d3-4abf-b932-b4d986671f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.376190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd97f98-49d3-4abf-b932-b4d986671f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.376190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd97f98-49d3-4abf-b932-b4d986671f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.376425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd97f98-49d3-4abf-b932-b4d986671f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:42.381151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd97f98-49d3-4abf-b932-b4d986671f51 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:42.401301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 895/1787] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:41 2022] DELETE /identity/v3/users/6cfc3bbcd29a4606a7ca8a2792b03f24 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:42.401301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:42.401301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:42.417350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 893/1788] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:42.420647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.422088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.422400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.461868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:42.476355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:42.480994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:42.606116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:42.662559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 894/1789] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Jul 29 04:43:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:42.664117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:42.665590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:42.667475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cd516-d19c-4105-9bc1-09482813d47e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:42.690757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e3f8e-482e-4272-8504-a22ee5dd7349 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:42.695699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7e7d2-53ef-41b5-8c95-f75be17e7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:42.696461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e7d2-53ef-41b5-8c95-f75be17e7a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.696855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e7d2-53ef-41b5-8c95-f75be17e7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.697139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7e7d2-53ef-41b5-8c95-f75be17e7a24 admin admin] PATH_INFO: `/v3/projects/d06411ae35e14b1b9cbaec1adc8d8f3d/users/688681ce1f8f4b9fa48e8b3cc1fa0255/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.697485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:42.698266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.698633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.698972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.699806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:42.706446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:42.746886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7e7d2-53ef-41b5-8c95-f75be17e7a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06411ae35e14b1b9cbaec1adc8d8f3d, user_id=688681ce1f8f4b9fa48e8b3cc1fa0255, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:42.754489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7e7d2-53ef-41b5-8c95-f75be17e7a24 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:42.771044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 896/1790] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:42.772106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:42.785764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 895/1791] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:42 2022] PUT /identity/v3/projects/d06411ae35e14b1b9cbaec1adc8d8f3d/users/688681ce1f8f4b9fa48e8b3cc1fa0255/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:42.795594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc646-3e79-4706-8ccd-273657621419 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.796385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc646-3e79-4706-8ccd-273657621419 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.797265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc646-3e79-4706-8ccd-273657621419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:42.802660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421b9ab-f434-4e80-85e7-5101f75c1d61 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:42.876297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-77edc646-3e79-4706-8ccd-273657621419 None None] MFA Rules not processed for user `688681ce1f8f4b9fa48e8b3cc1fa0255`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:42.878403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-77edc646-3e79-4706-8ccd-273657621419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:42.991200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:42.991200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:42.991200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:42.991978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] PATH_INFO: `/v3/projects/cdb90d0847474c859b083473bc812531/users/b2153b6563e8494f9c230133e4a66ddd/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.032699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb90d0847474c859b083473bc812531, user_id=b2153b6563e8494f9c230133e4a66ddd, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.036666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.079827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 896/1793] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:43.081101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 897/1793] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:42 2022] PUT /identity/v3/projects/cdb90d0847474c859b083473bc812531/users/b2153b6563e8494f9c230133e4a66ddd/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:43.082608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.083411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edc646-3e79-4706-8ccd-273657621419 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.085520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-77edc646-3e79-4706-8ccd-273657621419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:43.255741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6bb2-eda3-46d8-9529-78716118ded4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.258514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edc646-3e79-4706-8ccd-273657621419 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.262481 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.263248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.263650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.264037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.264877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.266840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.286765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 898/1794] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:43.290394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.312718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904928c4-b4a1-4ad6-9983-b331715ee87e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.316628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:43.321029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.321872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.322273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.322666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.324458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.326856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.344763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.350608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.350954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.351240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.378187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.379888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.397275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 897/1795] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:43.398304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.414951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 899/1796] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:43 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:43.419877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.425398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb5c05-cc91-491c-b9b7-6e5cd632782b service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.493945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:43.532933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e2739-6fdf-4697-9064-731e2e88f80c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.540527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.541847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.542302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.543187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.544201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.546806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.556900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1be82-2187-47eb-a4a5-a304eca92302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.557979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1be82-2187-47eb-a4a5-a304eca92302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.559322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1be82-2187-47eb-a4a5-a304eca92302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.560404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1be82-2187-47eb-a4a5-a304eca92302 admin admin] PATH_INFO: `/v3/projects/cdb90d0847474c859b083473bc812531/users/b2153b6563e8494f9c230133e4a66ddd/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.565815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1be82-2187-47eb-a4a5-a304eca92302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb90d0847474c859b083473bc812531, user_id=b2153b6563e8494f9c230133e4a66ddd, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.574165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1be82-2187-47eb-a4a5-a304eca92302 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.580398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 900/1797] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:43 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:43.585033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.611531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a988e-03d1-481f-b87d-2f0764fec93b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.621883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 898/1798] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:43 2022] PUT /identity/v3/projects/cdb90d0847474c859b083473bc812531/users/b2153b6563e8494f9c230133e4a66ddd/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:43.630244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.630700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.631208 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.697137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] MFA Rules not processed for user `b2153b6563e8494f9c230133e4a66ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:43.698689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:43.797112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.798008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.798447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.798729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.799997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.801467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.836140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 901/1799] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:43.837191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.860699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8773e-e00e-4f7b-a2f3-23125b7a9838 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:43.881650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:43.883076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:43.883816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:43.884484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] PATH_INFO: `/v3/projects/28b8c48883c84dc6aca271df97070616/users/89119cbac9e74db48bb8db67649bd20e/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:43.908630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 899/1800] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:43 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:43.917733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:43.919193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:43.923210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8c48883c84dc6aca271df97070616, user_id=89119cbac9e74db48bb8db67649bd20e, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:43.927881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:43.973785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 902/1801] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:43 2022] PUT /identity/v3/projects/28b8c48883c84dc6aca271df97070616/users/89119cbac9e74db48bb8db67649bd20e/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:43.977265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:44.059231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19ae9d-6656-4b35-b57c-ed612b09c01e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:44.081698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:44.153376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e7442-534d-45d0-b5e2-905e60c18d7a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:44.167504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:44.168216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:44.168618 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:44.168867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:44.169832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:44.172277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:44.193443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:44.194079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:44.194462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:44.194863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:44.210835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 903/1802] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:44.214635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:44.242409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc916f-c996-4d76-a3cc-0471831d16dc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:44.275988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90784-1630-4662-9566-817cef7b4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:44.276721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90784-1630-4662-9566-817cef7b4570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:44.279413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90784-1630-4662-9566-817cef7b4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:44.280017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90784-1630-4662-9566-817cef7b4570 admin admin] PATH_INFO: `/v3/projects/28b8c48883c84dc6aca271df97070616/users/89119cbac9e74db48bb8db67649bd20e/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:44.284550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90784-1630-4662-9566-817cef7b4570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8c48883c84dc6aca271df97070616, user_id=89119cbac9e74db48bb8db67649bd20e, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:44.292657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90784-1630-4662-9566-817cef7b4570 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:44.327930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 904/1803] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:44 2022] PUT /identity/v3/projects/28b8c48883c84dc6aca271df97070616/users/89119cbac9e74db48bb8db67649bd20e/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:44.341903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:44.342751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:44.343714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:44.355977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:44.361161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:44.397839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 900/1804] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:43 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:43:44.471851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] MFA Rules not processed for user `89119cbac9e74db48bb8db67649bd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:44.480600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:44.522130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:44.589003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:44.615858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94bc81-0f80-4fc1-9232-cab746d6db19 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:44.656941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 905/1805] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:44.661386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:44.666042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:44.844846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:44.845506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:44.845823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:44.846107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:44.861068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:44.888839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db91c6c-fb4d-4893-8467-d9cdd2b4744b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:44.911034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:44.912552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:44.915112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:44.915564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:44.955127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:44.956854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:44.992087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 906/1806] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:45.044747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:45.046198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:45.071445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 901/1807] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:45.426434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:45.548151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:45.551092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:45.610434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:45.638862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc567c82-b13a-492c-9618-01625fd59d3e service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:45.660847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:45.661532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:45.661857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:45.662135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] PATH_INFO: `/v3/users/688681ce1f8f4b9fa48e8b3cc1fa0255` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:45.664654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=688681ce1f8f4b9fa48e8b3cc1fa0255)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:45.673762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:45.794896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c45827-fcfc-4848-92b4-db58e73737ee service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:45.815715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:45.819308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:45.821733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:45.823465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] PATH_INFO: `/v3/projects/28250e635d6842e2bf55f4524ac7d09e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:45.827639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28250e635d6842e2bf55f4524ac7d09e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:45.837470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:45.876467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688681ce1f8f4b9fa48e8b3cc1fa0255'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:45.910339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688681ce1f8f4b9fa48e8b3cc1fa0255'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:45.912633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688681ce1f8f4b9fa48e8b3cc1fa0255'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:45.914280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688681ce1f8f4b9fa48e8b3cc1fa0255'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:45.924075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:45.964926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688681ce1f8f4b9fa48e8b3cc1fa0255'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.013047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 907/1808] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:45 2022] DELETE /identity/v3/users/688681ce1f8f4b9fa48e8b3cc1fa0255 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:46.018770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:46.020795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28250e635d6842e2bf55f4524ac7d09e', 'request_id': 'req-d865cdd5-5e44-45de-a5be-50556758f69d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.030007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:46.042625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28250e635d6842e2bf55f4524ac7d09e', 'request_id': 'req-d865cdd5-5e44-45de-a5be-50556758f69d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.081978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28250e635d6842e2bf55f4524ac7d09e', 'request_id': 'req-d865cdd5-5e44-45de-a5be-50556758f69d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.118440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] The token cache is being invalidate because project 28250e635d6842e2bf55f4524ac7d09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:46.118690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.119765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d865cdd5-5e44-45de-a5be-50556758f69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.121874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 902/1809] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:45 2022] DELETE /identity/v3/projects/28250e635d6842e2bf55f4524ac7d09e => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:46.126834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:46.126834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:46.126834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:46.168336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:46.169568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:46.336044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740207e2-1223-4165-b6e9-44eb653aa4ef admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:46.357768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:46.361510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:46.362397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:46.365137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] PATH_INFO: `/v3/projects/ebab2f978a6c415eb8e59b62665582e3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:46.376715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebab2f978a6c415eb8e59b62665582e3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:46.378603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:46.400040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 903/1810] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:46.401093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:46.410931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:46.446906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95cd48-7368-4f76-a497-fe87dcb4fc44 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:46.470875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:46.471701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:46.471989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:46.472262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] PATH_INFO: `/v3/users/bb8ca026110541d2873619be4bb8f93b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:46.473560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8ca026110541d2873619be4bb8f93b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:46.484679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:46.597110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebab2f978a6c415eb8e59b62665582e3', 'request_id': 'req-b2b1d944-a694-4e18-99a3-492f5d3263cd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.623258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebab2f978a6c415eb8e59b62665582e3', 'request_id': 'req-b2b1d944-a694-4e18-99a3-492f5d3263cd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.647885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebab2f978a6c415eb8e59b62665582e3', 'request_id': 'req-b2b1d944-a694-4e18-99a3-492f5d3263cd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.673902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:46.680601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8ca026110541d2873619be4bb8f93b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.686287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] The token cache is being invalidate because project ebab2f978a6c415eb8e59b62665582e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:46.686419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.689361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.697152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 908/1811] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:46 2022] DELETE /identity/v3/projects/ebab2f978a6c415eb8e59b62665582e3 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:46.698225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:46.701617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:46.708250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8ca026110541d2873619be4bb8f93b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.709414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8ca026110541d2873619be4bb8f93b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.712093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8ca026110541d2873619be4bb8f93b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.759752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3af66f32-bad9-4d22-854d-fbbf95086e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8ca026110541d2873619be4bb8f93b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:46.817939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 904/1812] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:46 2022] DELETE /identity/v3/users/bb8ca026110541d2873619be4bb8f93b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:46.819728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cd77-718c-4ce1-8bd7-159acf1c38be None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:46.826095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cd77-718c-4ce1-8bd7-159acf1c38be None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:46.827919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cd77-718c-4ce1-8bd7-159acf1c38be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:46.939734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d944-a694-4e18-99a3-492f5d3263cd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:46.951258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1186cd77-718c-4ce1-8bd7-159acf1c38be None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:46.959868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1186cd77-718c-4ce1-8bd7-159acf1c38be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:46.999124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:47.099599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.100592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.100882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.104935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.116673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:47.210356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 905/1813] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:47.211845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.212117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.212399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.244343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:47.245588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:47.272965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 906/1814] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:47.290706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:47.319095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8016d-332f-4ef6-8969-202207d487e1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:47.340938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.341695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.341882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.342152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.342921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:47.343197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.344844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:47.375620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.378631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:47.392139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 907/1815] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:47.392995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:47.416281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532570f-785c-4e48-acfc-785cb18e850c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:47.416998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 909/1816] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:47.421879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.422687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.422856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.423066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.423796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.425934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:47.464287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 908/1817] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:47 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:47.468523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:47.479038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01a84-8861-4ffd-8ac5-ff0e1374b0d8 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:47.619707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.620377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.620625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.620904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.621920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.623958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:47.703282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 910/1818] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:47 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:43:47.709882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:47.728332 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3ee56-90b6-4c0b-b02e-e9a0ad778fff admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:47.734806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.735454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.735743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.736018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.736724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.738378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:47.767330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:47.768300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 909/1819] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:47.784474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f86d0-7865-4178-a81b-1d72bf9623a2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:47.799770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e824485-6589-481b-8842-8c0af9448040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.800422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e824485-6589-481b-8842-8c0af9448040 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.800699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e824485-6589-481b-8842-8c0af9448040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.800984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e824485-6589-481b-8842-8c0af9448040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.801968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e824485-6589-481b-8842-8c0af9448040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.803654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e824485-6589-481b-8842-8c0af9448040 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:47.828857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 911/1820] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:43:47.831988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:47.851184 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3ccd1-0fdd-438c-82d5-03c1d64134c9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:47.862950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:47.863958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:47.864485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:47.864986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] PATH_INFO: `/v3/projects/6a4ebe13e0874e0083fcb222b3ca1f65/users/0b620590b8a7450e966e742201732e98/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:47.920486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4ebe13e0874e0083fcb222b3ca1f65, user_id=0b620590b8a7450e966e742201732e98, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:47.930204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:48.028290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 910/1821] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:47 2022] PUT /identity/v3/projects/6a4ebe13e0874e0083fcb222b3ca1f65/users/0b620590b8a7450e966e742201732e98/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:48.039876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d96f2-04e8-472b-9137-e37ba8a1e67c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:48.040153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d96f2-04e8-472b-9137-e37ba8a1e67c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:48.040439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d96f2-04e8-472b-9137-e37ba8a1e67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:48.114595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-789d96f2-04e8-472b-9137-e37ba8a1e67c None None] MFA Rules not processed for user `0b620590b8a7450e966e742201732e98`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:48.115877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-789d96f2-04e8-472b-9137-e37ba8a1e67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:48.256406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:48.359722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:48.360294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 912/1822] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:48.405268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f701f-c724-4983-9c3d-6e9e5b35ac4e None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:48.405485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f701f-c724-4983-9c3d-6e9e5b35ac4e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:48.405835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f701f-c724-4983-9c3d-6e9e5b35ac4e None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:48.407206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 913/1823] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:43:48.489749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:48.515653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:48.515942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:48.516222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:48.554838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641994a1-dd23-45bd-be74-0dcbe5fc0e83 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:48.570405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:48.572367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:48.585500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:48.586404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:48.586825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:48.587234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:48.588042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:48.591269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:48.688161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 911/1824] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:48 2022] POST /identity/v3/projects => generated 393 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:43:48.689145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:48.850391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 914/1825] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:43:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:48.904609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55d59c-ccf4-46f3-bb76-2ef9a5422a1a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:48.919664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:48.920290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:48.920577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:48.920854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:48.923754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:48.925976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:48.971189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:48.982399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 912/1826] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:48 2022] POST /identity/v3/users => generated 303 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:49.003505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058763c-8d27-457e-995f-30d350bbe1b8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:49.020341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:49.022144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.022742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.023456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.024768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:49.027614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:49.046730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:49.060230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 915/1827] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:49.064336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019bc47-26d8-409f-9048-87ac55893177 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:49.079286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:49.079757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.080146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.080487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] PATH_INFO: `/v3/projects/24d9aa7d19e6470d858ca0e4d1166dd8/users/1e811cdab8594d8fbf47fac6cfb807ed/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.106163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d9aa7d19e6470d858ca0e4d1166dd8, user_id=1e811cdab8594d8fbf47fac6cfb807ed, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:49.110233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:49.145916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:49.146002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 913/1828] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:49 2022] PUT /identity/v3/projects/24d9aa7d19e6470d858ca0e4d1166dd8/users/1e811cdab8594d8fbf47fac6cfb807ed/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:49.180246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1d194-32b4-45bf-9f3f-a7d68de67175 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:49.236240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:49.238155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:49.397799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:49.398724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.399125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.399515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.400346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:49.405013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:49.432233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 916/1829] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:49.436732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:49.451188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a1f8c-5704-435a-83b7-d99f928bbfed admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:49.455615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6d19d-2d8f-4830-8a96-ca792a7358dd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:49.476918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:49.478189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.478507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.478792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] PATH_INFO: `/v3/projects/6b64da83f81b414a9d82c1a3abdc1557` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.480352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c43492-a88c-40f5-b233-25905ae4800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:49.481263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c43492-a88c-40f5-b233-25905ae4800e admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.482631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c43492-a88c-40f5-b233-25905ae4800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.483056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c43492-a88c-40f5-b233-25905ae4800e admin admin] PATH_INFO: `/v3/projects/24d9aa7d19e6470d858ca0e4d1166dd8/users/1e811cdab8594d8fbf47fac6cfb807ed/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.484508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b64da83f81b414a9d82c1a3abdc1557)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:49.487158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:49.491018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c43492-a88c-40f5-b233-25905ae4800e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d9aa7d19e6470d858ca0e4d1166dd8, user_id=1e811cdab8594d8fbf47fac6cfb807ed, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:49.495765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c43492-a88c-40f5-b233-25905ae4800e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:49.539878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 917/1830] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:49 2022] PUT /identity/v3/projects/24d9aa7d19e6470d858ca0e4d1166dd8/users/1e811cdab8594d8fbf47fac6cfb807ed/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:43:49.550874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.551889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.552309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.591385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:49.610742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b64da83f81b414a9d82c1a3abdc1557', 'request_id': 'req-4adf248d-1328-49a0-a94a-abcecd43a753'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:49.617239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] MFA Rules not processed for user `1e811cdab8594d8fbf47fac6cfb807ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:49.621947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:49.622737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b64da83f81b414a9d82c1a3abdc1557', 'request_id': 'req-4adf248d-1328-49a0-a94a-abcecd43a753'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:49.641846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b64da83f81b414a9d82c1a3abdc1557', 'request_id': 'req-4adf248d-1328-49a0-a94a-abcecd43a753'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:49.658931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] The token cache is being invalidate because project 6b64da83f81b414a9d82c1a3abdc1557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:49.659600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:49.665036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4adf248d-1328-49a0-a94a-abcecd43a753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:49.673460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 914/1831] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:49 2022] DELETE /identity/v3/projects/6b64da83f81b414a9d82c1a3abdc1557 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:49.675331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2a5e-8180-412f-b08d-a44a34899f5f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.675834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2a5e-8180-412f-b08d-a44a34899f5f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.676330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2a5e-8180-412f-b08d-a44a34899f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:49.726474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-577e2a5e-8180-412f-b08d-a44a34899f5f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:49.729980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-577e2a5e-8180-412f-b08d-a44a34899f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:49.779129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:49.891399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 918/1832] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:49.903645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:49.906418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:49.966015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 915/1833] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:49.967719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:49.972120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:49.972712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.024266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:50.025838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:50.053752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 916/1834] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:50.054778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.055231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111a389-5473-4244-b53b-8cd715a2d980 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.067838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.069238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.069703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.070146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.077153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e549c-9be8-429c-8c41-246bbe88ea04 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.095156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.095966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.096375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.096779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.097471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.097719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:50.098138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.099870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.102047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.128721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 919/1835] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:43:50.136862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 917/1836] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:50.138010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.158709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f31a8-fc00-49f7-8d27-ede374a78db3 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.179973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.186914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.186914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.186914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.186914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.198176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.200564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.202727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:50.229381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c20aad-67f8-4f98-a931-64331541a6ef admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.245258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.246349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.247068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.247747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.255626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:50.274672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 920/1837] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:50 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:50.288791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.444087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94067-8ec5-43d1-91a0-5b65aae08b95 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.449719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.450412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.450752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.450967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.451667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.454359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.484313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 921/1838] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:50 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:50.485342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.487257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:50.505433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffe9a-24ce-4cde-bbcc-ccef2c207555 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.506616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.511005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.511795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.512098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.512499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] PATH_INFO: `/v3/projects/d06411ae35e14b1b9cbaec1adc8d8f3d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.513868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06411ae35e14b1b9cbaec1adc8d8f3d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.514339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.516609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.547348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 918/1839] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:50.550393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.553860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:50.575971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:50.597262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06411ae35e14b1b9cbaec1adc8d8f3d', 'request_id': 'req-95d35d73-8b18-4fbb-9137-45ab3898c8a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:50.606917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06411ae35e14b1b9cbaec1adc8d8f3d', 'request_id': 'req-95d35d73-8b18-4fbb-9137-45ab3898c8a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:50.622207 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06411ae35e14b1b9cbaec1adc8d8f3d', 'request_id': 'req-95d35d73-8b18-4fbb-9137-45ab3898c8a0'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:50.657555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] The token cache is being invalidate because project d06411ae35e14b1b9cbaec1adc8d8f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:50.658132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:50.665827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:50.671705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 922/1840] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:50 2022] DELETE /identity/v3/projects/d06411ae35e14b1b9cbaec1adc8d8f3d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:50.674664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.679750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:50.725613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:50.848314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487bf9-2bcb-4eb1-b1f9-5eba7eaa84c1 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.909781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d35d73-8b18-4fbb-9137-45ab3898c8a0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:50.922726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:50.923350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:50.924072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:50.924360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:50.927608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:50.929193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:50.971592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 923/1841] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:50.974773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:50.976682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:51.008636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b514e45-bfa1-4889-81d5-3666b10c4d8f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:51.036611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:51.039173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:51.039173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:51.040233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] PATH_INFO: `/v3/users/89119cbac9e74db48bb8db67649bd20e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:51.044397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89119cbac9e74db48bb8db67649bd20e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:51.054346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:51.180776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:51.183100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:51.183408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:51.184705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89119cbac9e74db48bb8db67649bd20e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:51.189223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:51.197106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89119cbac9e74db48bb8db67649bd20e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:51.198126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89119cbac9e74db48bb8db67649bd20e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:51.199019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89119cbac9e74db48bb8db67649bd20e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:51.200158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:51.221669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89119cbac9e74db48bb8db67649bd20e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:51.241886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 924/1842] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:50 2022] DELETE /identity/v3/users/89119cbac9e74db48bb8db67649bd20e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:51.242920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:51.244610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:51.248630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:51.267885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:51.289914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:51.322071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 919/1843] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:51.364874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d90c-2bb1-4191-94db-a96fdae82b6e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:51.379169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0808d-43bd-42f2-8be8-ae38c4189f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:51.379953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0808d-43bd-42f2-8be8-ae38c4189f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:51.381007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0808d-43bd-42f2-8be8-ae38c4189f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:51.382297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0808d-43bd-42f2-8be8-ae38c4189f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:51.383031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0808d-43bd-42f2-8be8-ae38c4189f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:51.390493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0808d-43bd-42f2-8be8-ae38c4189f3b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:51.419864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 925/1844] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:51.421444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:51.437169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00323-301c-47ae-b513-15d1b11be417 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:51.451539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:51.452921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:51.455575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:51.455888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] PATH_INFO: `/v3/projects/5ed420a0de464373be24871fdd9af278/users/cae14bb295ac4f0e8420bdede697d254/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:51.498213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed420a0de464373be24871fdd9af278, user_id=cae14bb295ac4f0e8420bdede697d254, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:51.502394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:51.563259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 920/1845] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:51 2022] PUT /identity/v3/projects/5ed420a0de464373be24871fdd9af278/users/cae14bb295ac4f0e8420bdede697d254/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:51.565436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:51.565832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:51.566120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:51.613318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] MFA Rules not processed for user `cae14bb295ac4f0e8420bdede697d254`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:51.621427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:51.759069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:51.759736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 926/1846] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:51.877730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925be9a-06f8-446b-afb0-159cbf756eae admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:51.884706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:51.886227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:51.887408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:51.887707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:51.889561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:51.892297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:51.962017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:51.977730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 921/1847] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:51 2022] POST /identity/v3/projects => generated 399 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:51.995418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e2e5c-a144-4d1f-9164-abad8d09f109 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:52.168308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:52.169212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:52.169504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:52.169818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:52.170579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:52.182243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:52.231257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 927/1848] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:51 2022] POST /identity/v3/users => generated 306 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:52.235571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:52.252766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c9b4-cdb5-4a02-a273-b54d6b8187bc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:52.260858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:52.261567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:52.262020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:52.262260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:52.263039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:52.265013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:52.298407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:52.313362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 922/1849] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:52.318667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86fb6-36a1-4514-8486-cee80c3983ad admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:52.334494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:52.334941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:52.335281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:52.335659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] PATH_INFO: `/v3/projects/91ed78a349e646dcb65cc4c3188d968b/users/bbd35bfbb2d248b2a028ea093980657c/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:52.370490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ed78a349e646dcb65cc4c3188d968b, user_id=bbd35bfbb2d248b2a028ea093980657c, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:52.373775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:52.399379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 928/1850] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:52 2022] PUT /identity/v3/projects/91ed78a349e646dcb65cc4c3188d968b/users/bbd35bfbb2d248b2a028ea093980657c/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:52.403522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:52.421927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49b5d5-b71b-4eaa-b0bb-3c4ec753009f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:52.451790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:52.559410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f715d-54e1-4286-b18d-a51885f40506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:52.560340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f715d-54e1-4286-b18d-a51885f40506 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:52.561476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f715d-54e1-4286-b18d-a51885f40506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:52.563227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f715d-54e1-4286-b18d-a51885f40506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:52.564207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f715d-54e1-4286-b18d-a51885f40506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:52.570353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f715d-54e1-4286-b18d-a51885f40506 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:52.601975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:52.614531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 923/1851] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:52.636536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506786a-fabd-4e95-8a13-2348105db400 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:52.664517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:52.665511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:52.665822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:52.667831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] PATH_INFO: `/v3/projects/91ed78a349e646dcb65cc4c3188d968b/users/bbd35bfbb2d248b2a028ea093980657c/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:52.677673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ed78a349e646dcb65cc4c3188d968b, user_id=bbd35bfbb2d248b2a028ea093980657c, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:52.688442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:52.738103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 929/1852] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:52 2022] PUT /identity/v3/projects/91ed78a349e646dcb65cc4c3188d968b/users/bbd35bfbb2d248b2a028ea093980657c/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:52.761654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:52.761654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:52.761654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:52.788957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] MFA Rules not processed for user `bbd35bfbb2d248b2a028ea093980657c`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:52.790459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.002212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 924/1853] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:53.017146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:53.023168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:53.024142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.024620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.046235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:53.199755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3958-25f9-4335-9fd1-0ed5d3f2db7f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:53.209840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:53.211910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.212768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.213641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] PATH_INFO: `/v3/projects/28b8c48883c84dc6aca271df97070616` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.215246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b8c48883c84dc6aca271df97070616)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:53.218432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:53.250594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dbf88-3727-455d-8d7b-f51d3670ee77 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:53.253238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46babf17-9eae-42a0-8c1c-7fe4b7d9fb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:53.254130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babf17-9eae-42a0-8c1c-7fe4b7d9fb2a service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.254487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babf17-9eae-42a0-8c1c-7fe4b7d9fb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.254720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babf17-9eae-42a0-8c1c-7fe4b7d9fb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.283551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46babf17-9eae-42a0-8c1c-7fe4b7d9fb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:53.285513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46babf17-9eae-42a0-8c1c-7fe4b7d9fb2a service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:53.316313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 930/1854] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:53.318362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:53.324503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b8c48883c84dc6aca271df97070616', 'request_id': 'req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:53.334492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b8c48883c84dc6aca271df97070616', 'request_id': 'req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:53.344143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b8c48883c84dc6aca271df97070616', 'request_id': 'req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:53.369581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c6f7-2f9b-4c76-bb00-79411f76d713 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.369581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c6f7-2f9b-4c76-bb00-79411f76d713 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.369581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c6f7-2f9b-4c76-bb00-79411f76d713 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.371402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 931/1855] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:43:53.408984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] The token cache is being invalidate because project 28b8c48883c84dc6aca271df97070616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:53.410087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:53.411494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.411698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c4b0aa0b-7380-4ba5-a3ad-8facf1553d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:53.411857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.412593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.414783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 925/1856] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:53 2022] DELETE /identity/v3/projects/28b8c48883c84dc6aca271df97070616 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:53.424535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93301-53e4-417b-9371-9188a670f39f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.424827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93301-53e4-417b-9371-9188a670f39f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.425105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a93301-53e4-417b-9371-9188a670f39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.456437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:53.458906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.498487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-08a93301-53e4-417b-9371-9188a670f39f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:53.500412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-08a93301-53e4-417b-9371-9188a670f39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.694029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 932/1857] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:53.694914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:53.697079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.721262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 926/1858] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:53.723441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.723731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.725847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.767584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:53.768840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.795040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 927/1859] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:53.796227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:53.818886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177a6e9-e4f6-4239-8c63-46977e0535b3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:53.831689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:53.832321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.832617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.832860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.833555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:53.833873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:53.836843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:53.842726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba534e7a-fbd7-40ca-b177-c4ed34e9af78 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:53.852323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:53.852888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.853164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.853434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.856480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:53.865677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 928/1860] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:53.866743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:53.884312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24bf6f-2a9c-4706-892b-9d8e512144fa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:53.899468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:53.900101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:53.900384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:53.900655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:53.901323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:53.903254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:53.976986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 929/1861] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:53 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:53.976986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:53.987617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:53.996507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:53.998143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.049653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 933/1862] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:54.118748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6205f-173e-4167-9489-c620f3b490a1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:54.136080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:54.136249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:54.136727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.137005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.137281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.137977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:54.138425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:54.141226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.175984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba39a7-e6fe-4b13-9519-58af40a90e9a service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:54.192232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 930/1863] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:53 2022] POST /identity/v3/users => generated 304 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:54.198310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:54.232926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1c029-b1a8-4667-8fb3-221fefaa2c58 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:54.246806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:54.247443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.247737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.248017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.255769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:54.255769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.270228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 931/1864] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:54.276597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:54.277764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a347bb-f8ea-4d95-b731-907779030901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:54.278971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a347bb-f8ea-4d95-b731-907779030901 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.279261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a347bb-f8ea-4d95-b731-907779030901 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.279540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a347bb-f8ea-4d95-b731-907779030901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.292259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71932-7c78-4d89-9260-462ab1d394ac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:54.307351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:54.308087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.308370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.308648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.309354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:54.309647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a347bb-f8ea-4d95-b731-907779030901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:54.311038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.314016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a347bb-f8ea-4d95-b731-907779030901 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.315908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:54.334682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 932/1865] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:54.335724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:54.349767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bd800-d89d-42c4-b03c-59b883672b4b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:54.357074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:54.358095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.358387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.359203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] PATH_INFO: `/v3/projects/833ab6fde72948b59dcef3836c094c11/users/5603def473044dfabc4f944e6cc29712/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.372135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 934/1866] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:54.382171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=833ab6fde72948b59dcef3836c094c11, user_id=5603def473044dfabc4f944e6cc29712, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:54.386101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.421830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 933/1867] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:54 2022] PUT /identity/v3/projects/833ab6fde72948b59dcef3836c094c11/users/5603def473044dfabc4f944e6cc29712/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:54.433221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.433568 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.433927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.509995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] MFA Rules not processed for user `5603def473044dfabc4f944e6cc29712`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:54.511244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:54.737756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 935/1868] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:54.743180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:54.895275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fb4e3-e0f6-4d2b-ba2b-7b34afb8b72e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:54.902496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:54.903342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:54.903743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:54.904329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:54.905168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:54.908829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:54.952904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 934/1869] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:54 2022] POST /identity/v3/projects => generated 407 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:54.953983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:54.984449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401411-31ce-4797-b1df-9f90e79ff44c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.081969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.081969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.081969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.081969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.082876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.084491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.104490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:55.115260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 936/1870] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:54 2022] POST /identity/v3/users => generated 310 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:55.119961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:55.148633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ecd85-c2e5-47a2-ac3d-dafffd2b20d5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.159508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.160631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.161134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.161829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.162812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.165798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.193094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 935/1871] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:55.195386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:55.217668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e4447-9306-464b-b7df-0fd28ee3ac02 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.226223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.227369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.227691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.228026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] PATH_INFO: `/v3/projects/09f8cc06e2374891b4bbacf0c023b6e9/users/f50b9ed0c45d4458b2092f9a9f614185/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.270962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f8cc06e2374891b4bbacf0c023b6e9, user_id=f50b9ed0c45d4458b2092f9a9f614185, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.274299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.303208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 937/1872] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:55 2022] PUT /identity/v3/projects/09f8cc06e2374891b4bbacf0c023b6e9/users/f50b9ed0c45d4458b2092f9a9f614185/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:43:55.307044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:55.317437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c249-2bac-41f5-bb8a-9b103e4d76b2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.381708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915463-3da3-46cd-930b-adc1ebb50f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.382340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915463-3da3-46cd-930b-adc1ebb50f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.382620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915463-3da3-46cd-930b-adc1ebb50f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.382899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915463-3da3-46cd-930b-adc1ebb50f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.383628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a915463-3da3-46cd-930b-adc1ebb50f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.385398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a915463-3da3-46cd-930b-adc1ebb50f4a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.400975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 936/1873] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:55.402704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:55.434042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7d10-7e62-4dbe-8d06-e2d62413418c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.441076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.442523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.442918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.443839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] PATH_INFO: `/v3/projects/09f8cc06e2374891b4bbacf0c023b6e9/users/f50b9ed0c45d4458b2092f9a9f614185/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.445994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f8cc06e2374891b4bbacf0c023b6e9, user_id=f50b9ed0c45d4458b2092f9a9f614185, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.448783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.462773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 938/1874] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:55 2022] PUT /identity/v3/projects/09f8cc06e2374891b4bbacf0c023b6e9/users/f50b9ed0c45d4458b2092f9a9f614185/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:55.474556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.474846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.475128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.507130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] MFA Rules not processed for user `f50b9ed0c45d4458b2092f9a9f614185`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:55.508306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:55.554875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:55.605906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 937/1875] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:55 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:55.616778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:55.619805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:55.679471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762988d7-b7ce-476a-8711-f054a33f4e0d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.683081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.683703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.683986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.684265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.693912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.695340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.705624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 939/1876] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:55 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:55.894042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:55.905933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd227c0c-0b02-4a8b-b648-313f133c1a72 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:55.909432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37043e9-692a-474b-9485-52edeacf0e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:55.910110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37043e9-692a-474b-9485-52edeacf0e36 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:55.910388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37043e9-692a-474b-9485-52edeacf0e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:55.910662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37043e9-692a-474b-9485-52edeacf0e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:55.969944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37043e9-692a-474b-9485-52edeacf0e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:55.971384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37043e9-692a-474b-9485-52edeacf0e36 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:55.981738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 938/1877] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:56.281854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:56.288003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:56.370252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08fba-ac20-49af-895e-17f3de571dcf service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:56.374777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:56.375417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:56.375702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:56.375980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] PATH_INFO: `/v3/users/0b620590b8a7450e966e742201732e98` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:56.377151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b620590b8a7450e966e742201732e98)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:56.379099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:56.431796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b620590b8a7450e966e742201732e98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:56.440077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b620590b8a7450e966e742201732e98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:56.440851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b620590b8a7450e966e742201732e98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:56.441539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b620590b8a7450e966e742201732e98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:56.454128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:56.461518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b620590b8a7450e966e742201732e98'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:56.477321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 940/1878] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:56 2022] DELETE /identity/v3/users/0b620590b8a7450e966e742201732e98 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:56.481562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:56.481838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:56.482114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:56.502012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:56.503235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:56.573810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 939/1879] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:56.585311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:56.587316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:56.663077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda8748-c740-4b96-aef8-9604528b5637 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:56.667122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:56.667823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:56.668180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:56.668873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:56.681199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:56.683535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:56.696410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 941/1880] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:57.096091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:57.098520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:57.113262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e471ae0-c3ff-4a41-9ec2-acd697051622 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:57.118054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:57.118704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:57.118989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:57.119311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] PATH_INFO: `/v3/projects/6a4ebe13e0874e0083fcb222b3ca1f65` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:57.120467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4ebe13e0874e0083fcb222b3ca1f65)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:57.122405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:57.173527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4ebe13e0874e0083fcb222b3ca1f65', 'request_id': 'req-de8ad150-752c-473f-bb9c-31be128422cf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.179923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4ebe13e0874e0083fcb222b3ca1f65', 'request_id': 'req-de8ad150-752c-473f-bb9c-31be128422cf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.185807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4ebe13e0874e0083fcb222b3ca1f65', 'request_id': 'req-de8ad150-752c-473f-bb9c-31be128422cf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.187973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:57.201379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] The token cache is being invalidate because project 6a4ebe13e0874e0083fcb222b3ca1f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:57.201801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.203112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.204696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 940/1881] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:57 2022] DELETE /identity/v3/projects/6a4ebe13e0874e0083fcb222b3ca1f65 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:57.208678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:57.218399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec00a-d5de-4d77-9e95-c37db6fffd8d service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:57.295813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:57.296779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:57.297149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:57.297531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] PATH_INFO: `/v3/users/1e811cdab8594d8fbf47fac6cfb807ed` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:57.298976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e811cdab8594d8fbf47fac6cfb807ed)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:57.301261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:57.395257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e811cdab8594d8fbf47fac6cfb807ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.403188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e811cdab8594d8fbf47fac6cfb807ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.403998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e811cdab8594d8fbf47fac6cfb807ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.404783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e811cdab8594d8fbf47fac6cfb807ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.417475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9316fcee-8dde-489a-8636-676ff27b5bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e811cdab8594d8fbf47fac6cfb807ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.432252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 942/1882] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:57 2022] DELETE /identity/v3/users/1e811cdab8594d8fbf47fac6cfb807ed => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:57.750762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:57.752949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:57.774320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad150-752c-473f-bb9c-31be128422cf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:57.835861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:57.836507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:57.836793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:57.837074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] PATH_INFO: `/v3/projects/24d9aa7d19e6470d858ca0e4d1166dd8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:57.838239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d9aa7d19e6470d858ca0e4d1166dd8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:57.840141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:57.886220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d9aa7d19e6470d858ca0e4d1166dd8', 'request_id': 'req-89566f04-1b60-4a47-9085-f83710ba6e67'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.893100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d9aa7d19e6470d858ca0e4d1166dd8', 'request_id': 'req-89566f04-1b60-4a47-9085-f83710ba6e67'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.898739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d9aa7d19e6470d858ca0e4d1166dd8', 'request_id': 'req-89566f04-1b60-4a47-9085-f83710ba6e67'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.911662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] The token cache is being invalidate because project 24d9aa7d19e6470d858ca0e4d1166dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:43:57.911950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.912583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-89566f04-1b60-4a47-9085-f83710ba6e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:57.914136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 941/1883] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:57 2022] DELETE /identity/v3/projects/24d9aa7d19e6470d858ca0e4d1166dd8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:57.919105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:57.919486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:57.919835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:57.934545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:57.952268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:57.954377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.031456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 943/1884] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:58.036515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.036886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.037080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.077829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:58.077829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.089636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 942/1885] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:58.093968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.107032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16728d69-6ea4-4649-aa8e-34774d92c469 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.114553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.115763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.116262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.116760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.117738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:43:58.118452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.121419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.146156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 944/1886] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:43:58.171955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.196733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0751a8-f008-4ace-b92b-48c0e95f1eba None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.206787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.209829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.209829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.209829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.216366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.219968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.308836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 943/1887] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:58 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:58.310204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.325272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9938-c7b5-4ed2-895c-5f67e1dd576b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.411416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.413937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.414299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.414629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.415340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.417505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.448688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 945/1888] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:58 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:58.453954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.477458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856160-4167-4138-8fb9-450dd0e57de7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.485419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.486937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.487667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.489825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.491729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.494267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.500752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.511180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.521092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aff22-215d-4034-88dc-6577f6863674 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.527190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.528912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.529755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.531922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] PATH_INFO: `/v3/users/cae14bb295ac4f0e8420bdede697d254` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.542235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 944/1889] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:43:58.546910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae14bb295ac4f0e8420bdede697d254)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.550110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.550255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.562997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db3dd9-7214-4487-b361-3c800670fa21 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.591952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.591952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.591952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.591952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.592241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.592241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.604194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 945/1890] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:58.609069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.620448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b4ec5-47f0-483b-a909-f7b1a29b745b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.626878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0c178-4138-4f17-b920-f7f81e4b7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.627857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0c178-4138-4f17-b920-f7f81e4b7715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.628109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0c178-4138-4f17-b920-f7f81e4b7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.628589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0c178-4138-4f17-b920-f7f81e4b7715 admin admin] PATH_INFO: `/v3/projects/8c2ca36369ec45f9a35d87fcdef58faa/users/9058a46736c54d17b7b24d0320c9348f/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.653541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae14bb295ac4f0e8420bdede697d254'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:58.662203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0c178-4138-4f17-b920-f7f81e4b7715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2ca36369ec45f9a35d87fcdef58faa, user_id=9058a46736c54d17b7b24d0320c9348f, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.664296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae14bb295ac4f0e8420bdede697d254'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:58.665167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae14bb295ac4f0e8420bdede697d254'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:58.666284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae14bb295ac4f0e8420bdede697d254'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:58.666524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0c178-4138-4f17-b920-f7f81e4b7715 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:58.684907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4880ef50-5c2b-4cf0-972c-7dc6b8c952f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae14bb295ac4f0e8420bdede697d254'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:58.691885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:58.695112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 946/1891] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:58 2022] PUT /identity/v3/projects/8c2ca36369ec45f9a35d87fcdef58faa/users/9058a46736c54d17b7b24d0320c9348f/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:58.706394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.706585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.706907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.729911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 946/1892] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:43:58 2022] DELETE /identity/v3/users/cae14bb295ac4f0e8420bdede697d254 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:43:58.733894 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.734371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.734734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.758264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:58.784339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] MFA Rules not processed for user `9058a46736c54d17b7b24d0320c9348f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:58.786039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.816106 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:58.819534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.890281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 947/1893] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:43:58.894997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.896446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.922478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 947/1894] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:58.941159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:58.943545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:58.973056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fcf4f-f0de-4506-bdaa-bab8dbef2d91 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:58.978544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:58.979162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:58.979502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:58.979783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:58.980443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:58.982398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.014378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c3d-7789-42d7-b651-f7ad61c2be14 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.018560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.022635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.022786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 948/1895] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:43:58 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:43:59.022877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.022877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.023636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.033082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.034713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.054434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 948/1896] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:59.088932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81bbe3-3f30-4a1d-91e4-004dd13d7e20 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.096412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.097193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.097482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.097806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.098475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.100443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.127679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 949/1897] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:43:59 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:43:59.128839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.143483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7c3da-1b44-472f-905e-ab53316ed4d2 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.149041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.149701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.150589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.150589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.150992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.152790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.169058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 949/1898] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:43:59.170307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.183613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f5291-4f31-4679-8a62-0a3d2706b5a3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.191334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.192076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.192543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.192825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] PATH_INFO: `/v3/projects/97876ec7d6444bfbb2f5f1f0feef5a62/users/b00c75d118534958b54e474342ec5929/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.208170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:59.222025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97876ec7d6444bfbb2f5f1f0feef5a62, user_id=b00c75d118534958b54e474342ec5929, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.225658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.243545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 950/1899] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:59 2022] PUT /identity/v3/projects/97876ec7d6444bfbb2f5f1f0feef5a62/users/b00c75d118534958b54e474342ec5929/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:59.247497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.260124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0966cb-e01f-4cad-919d-50ebc71b652f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.381069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ae359-78f5-4e00-b64e-5240e6641bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.381778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae359-78f5-4e00-b64e-5240e6641bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.382002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae359-78f5-4e00-b64e-5240e6641bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.382281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ae359-78f5-4e00-b64e-5240e6641bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.382981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ae359-78f5-4e00-b64e-5240e6641bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.384730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ae359-78f5-4e00-b64e-5240e6641bcf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.408967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 950/1900] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:43:59.413782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.430475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2f73b-2fc9-4578-b534-e8a82551d4c5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.439148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.440170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.440758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.441179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] PATH_INFO: `/v3/projects/97876ec7d6444bfbb2f5f1f0feef5a62/users/b00c75d118534958b54e474342ec5929/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.443592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97876ec7d6444bfbb2f5f1f0feef5a62, user_id=b00c75d118534958b54e474342ec5929, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.448338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.470947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 951/1901] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:43:59 2022] PUT /identity/v3/projects/97876ec7d6444bfbb2f5f1f0feef5a62/users/b00c75d118534958b54e474342ec5929/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:43:59.480195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.481190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.481704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.533174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] MFA Rules not processed for user `b00c75d118534958b54e474342ec5929`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:43:59.534751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:59.551238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:43:59.642324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.651290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:59.655901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 951/1902] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:43:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:43:59.656929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:43:59.661465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:43:59.773107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2a761-1727-4a52-a8e5-608bf4156de0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.786039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.786818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.787110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.787385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.802572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445d94-1cb0-4c79-add5-5ca3d5219eb0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:43:59.816527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:43:59.817710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.818369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:43:59.819368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.821171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:43:59.821435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] PATH_INFO: `/v3/projects/5ed420a0de464373be24871fdd9af278` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:43:59.822781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed420a0de464373be24871fdd9af278)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:43:59.825656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:43:59.846014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 952/1903] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:43:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:43:59.942424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed420a0de464373be24871fdd9af278', 'request_id': 'req-479d5539-64fb-412b-861f-3cf3b5a1ba1c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:59.968054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed420a0de464373be24871fdd9af278', 'request_id': 'req-479d5539-64fb-412b-861f-3cf3b5a1ba1c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:43:59.982786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed420a0de464373be24871fdd9af278', 'request_id': 'req-479d5539-64fb-412b-861f-3cf3b5a1ba1c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.013981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] The token cache is being invalidate because project 5ed420a0de464373be24871fdd9af278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:00.014276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.016600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.020308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 952/1904] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:43:59 2022] DELETE /identity/v3/projects/5ed420a0de464373be24871fdd9af278 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:00.024511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:00.036943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a1165-005c-4e93-a4f9-b7a1fddaf3e2 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:00.118476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:00.119347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:00.119893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:00.120195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] PATH_INFO: `/v3/users/bbd35bfbb2d248b2a028ea093980657c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:00.121422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd35bfbb2d248b2a028ea093980657c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:00.123607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:00.196404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd35bfbb2d248b2a028ea093980657c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.207881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:00.210987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd35bfbb2d248b2a028ea093980657c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.212517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd35bfbb2d248b2a028ea093980657c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.213730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd35bfbb2d248b2a028ea093980657c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.231515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd35bfbb2d248b2a028ea093980657c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.254031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 953/1905] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:00 2022] DELETE /identity/v3/users/bbd35bfbb2d248b2a028ea093980657c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:00.567587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:00.569423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:00.582567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d5539-64fb-412b-861f-3cf3b5a1ba1c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:00.620677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:00.622272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:00.646577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:00.647513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:00.647804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:00.648083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] PATH_INFO: `/v3/users/9058a46736c54d17b7b24d0320c9348f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:00.649638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9058a46736c54d17b7b24d0320c9348f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:00.651565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:00.658844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:00.742385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9058a46736c54d17b7b24d0320c9348f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.742593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873e2b1-de32-4ed7-a450-88209c89d147 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:00.753722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9058a46736c54d17b7b24d0320c9348f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.755462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9058a46736c54d17b7b24d0320c9348f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.756091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9058a46736c54d17b7b24d0320c9348f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.756500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:00.757171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:00.757458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:00.757765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] PATH_INFO: `/v3/projects/91ed78a349e646dcb65cc4c3188d968b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:00.759022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ed78a349e646dcb65cc4c3188d968b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:00.760976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:00.781493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1045fabc-5826-4b37-ab23-73f86ea0affc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9058a46736c54d17b7b24d0320c9348f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.801002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 953/1906] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:00 2022] DELETE /identity/v3/users/9058a46736c54d17b7b24d0320c9348f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:00.808029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:00.808322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:00.808642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:00.840764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:00.843582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:00.852063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ed78a349e646dcb65cc4c3188d968b', 'request_id': 'req-50609d09-17f6-400b-a687-ee77a5ad764a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.868723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ed78a349e646dcb65cc4c3188d968b', 'request_id': 'req-50609d09-17f6-400b-a687-ee77a5ad764a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.896020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ed78a349e646dcb65cc4c3188d968b', 'request_id': 'req-50609d09-17f6-400b-a687-ee77a5ad764a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.925174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] The token cache is being invalidate because project 91ed78a349e646dcb65cc4c3188d968b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:00.925565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.928722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-50609d09-17f6-400b-a687-ee77a5ad764a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:00.930674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 954/1907] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:00 2022] DELETE /identity/v3/projects/91ed78a349e646dcb65cc4c3188d968b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:00.935405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c54df-aec9-4434-81ea-a76cc0429205 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:00.935588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c54df-aec9-4434-81ea-a76cc0429205 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:00.935864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c54df-aec9-4434-81ea-a76cc0429205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:00.945642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 954/1908] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:00.955521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:00.956481 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a67c54df-aec9-4434-81ea-a76cc0429205 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:00.956879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:00.957668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a67c54df-aec9-4434-81ea-a76cc0429205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:00.965641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 955/1909] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:00.975134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:00.975527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:00.975905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:00.996698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:00.998210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.007537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 956/1910] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:01.012096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.018270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2086b04-1d73-40bf-9754-954317e6e7bf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.025530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696d14-ded2-4b73-997a-89abefc0db98 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.031515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.032275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.032624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.032960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.033998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:01.034475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.037111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.038346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.039049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.039338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.039640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.052073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.053783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.063093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 957/1911] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:01.063996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 955/1912] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:01.067195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.078050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6042ac-c071-4a21-b5b5-a80052821fa7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.082631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.083246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.083529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.083807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.084482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.086848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.121671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 958/1913] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:01 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:01.122840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.142663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97bad2-46af-4506-adf1-9443bd83b29b service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.171981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:01.214506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.215229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.215587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.215945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.216798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.219446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.251252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 956/1914] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:01 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:01.255180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.267703 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c94bc-fc52-4f02-81d3-7d70e7acb2ed admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.272766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.273398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.273720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.274000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.274710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.276319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.290152 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 959/1915] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:01.291062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.304821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d255-7e0b-457c-bf3d-695e3da51869 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.309914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4633-08e0-45d1-982d-24b55a3be6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.310544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4633-08e0-45d1-982d-24b55a3be6db admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.310994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4633-08e0-45d1-982d-24b55a3be6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.311348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4633-08e0-45d1-982d-24b55a3be6db admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.312642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4633-08e0-45d1-982d-24b55a3be6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.314284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4633-08e0-45d1-982d-24b55a3be6db admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.325513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 957/1916] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:01.329525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.335913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:01.343012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba272a6-3921-495d-a5c7-39aefc73d1c9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.351611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.353733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.354022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.354303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] PATH_INFO: `/v3/projects/5d31aeb800dc4b5cb7ed0bc7913504e0/users/937be4164e59480faf38f798c3501b08/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.372656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d31aeb800dc4b5cb7ed0bc7913504e0, user_id=937be4164e59480faf38f798c3501b08, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.376071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.392887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 960/1917] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:01 2022] PUT /identity/v3/projects/5d31aeb800dc4b5cb7ed0bc7913504e0/users/937be4164e59480faf38f798c3501b08/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:01.403138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.403430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.403707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.443316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] MFA Rules not processed for user `937be4164e59480faf38f798c3501b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:01.444665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.458288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.460211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.521048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 958/1918] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:01.532884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.534299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.538813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc64be-2687-4f02-8741-5e91f4790e62 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.544643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.545754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.546607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.547173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] PATH_INFO: `/v3/projects/8c2ca36369ec45f9a35d87fcdef58faa` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.548356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2ca36369ec45f9a35d87fcdef58faa)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.550483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.604089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a0956-1ac0-497f-bb7e-c66755fb18e7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.614275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2ca36369ec45f9a35d87fcdef58faa', 'request_id': 'req-c41c0697-fc66-4fca-b680-99ff676fced5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.622985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2ca36369ec45f9a35d87fcdef58faa', 'request_id': 'req-c41c0697-fc66-4fca-b680-99ff676fced5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.631341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2ca36369ec45f9a35d87fcdef58faa', 'request_id': 'req-c41c0697-fc66-4fca-b680-99ff676fced5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.650335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] The token cache is being invalidate because project 8c2ca36369ec45f9a35d87fcdef58faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:01.650635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.651355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.653678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 961/1919] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:01 2022] DELETE /identity/v3/projects/8c2ca36369ec45f9a35d87fcdef58faa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:01.658654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.660828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.673244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.674449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.674838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.675377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.677842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.684303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:01.752079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c0697-fc66-4fca-b680-99ff676fced5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.760223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.761533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.762004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.762291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] PATH_INFO: `/v3/users/b00c75d118534958b54e474342ec5929` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.763687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00c75d118534958b54e474342ec5929)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.767436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.770232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.771953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.798482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:01.811921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 959/1920] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:01.843367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00c75d118534958b54e474342ec5929'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.853126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:01.853361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00c75d118534958b54e474342ec5929'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.854743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00c75d118534958b54e474342ec5929'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.855122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:01.855965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00c75d118534958b54e474342ec5929'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.870934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0b04691c-51d3-4ffb-9ca9-f918daa89ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00c75d118534958b54e474342ec5929'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.871501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71c2cc-4b29-4808-9e82-0b67700e4925 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:01.877240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:01.878057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:01.878375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:01.878818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] PATH_INFO: `/v3/users/937be4164e59480faf38f798c3501b08` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:01.880347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=937be4164e59480faf38f798c3501b08)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:01.882525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:01.891346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 962/1921] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:01 2022] DELETE /identity/v3/users/b00c75d118534958b54e474342ec5929 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:01.944580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937be4164e59480faf38f798c3501b08'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.952834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937be4164e59480faf38f798c3501b08'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.953589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937be4164e59480faf38f798c3501b08'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.955217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937be4164e59480faf38f798c3501b08'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:01.975542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6550d256-99e2-4cb0-8300-1a422dea0acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937be4164e59480faf38f798c3501b08'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.000650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 960/1922] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:01 2022] DELETE /identity/v3/users/937be4164e59480faf38f798c3501b08 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:02.007139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.007627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.008602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.041200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:02.042841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.047172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4627da-7022-407a-a3a8-e412d0e58213 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.047454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4627da-7022-407a-a3a8-e412d0e58213 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.048382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4627da-7022-407a-a3a8-e412d0e58213 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.052076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 961/1923] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:44:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 29 04:44:02.067391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.067676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.067988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.104744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:02.106246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.137508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 963/1924] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:02.160681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:02.160681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.215918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 962/1925] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:44:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:02.229711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:02.231230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.231342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f38a5-bab0-4cab-9517-602c980a55b1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:02.235176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:02.235800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.236086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.236366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.249742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:02.249742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:02.258660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c0785-5902-46ae-8a0f-612f931c7b2d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:02.266774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:02.267583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.268008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.268489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.274639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 964/1926] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:02.277808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:02.282522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:02.284585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:02.304008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 963/1927] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:02.514307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:02.516909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.531057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd92bf7-b099-49ff-8239-82dc4c048229 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:02.537515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:02.538718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.544217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.551046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] PATH_INFO: `/v3/projects/97876ec7d6444bfbb2f5f1f0feef5a62` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.574564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97876ec7d6444bfbb2f5f1f0feef5a62)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:02.577077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:02.622698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:02.644603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97876ec7d6444bfbb2f5f1f0feef5a62', 'request_id': 'req-28d6936e-4317-4dea-8bfe-39bc0ff81b67'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.654286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:02.655770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.662796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97876ec7d6444bfbb2f5f1f0feef5a62', 'request_id': 'req-28d6936e-4317-4dea-8bfe-39bc0ff81b67'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.669496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97876ec7d6444bfbb2f5f1f0feef5a62', 'request_id': 'req-28d6936e-4317-4dea-8bfe-39bc0ff81b67'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.677814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e03a-973f-4a8f-b0b7-ab4c356ddd0f service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:02.689558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] The token cache is being invalidate because project 97876ec7d6444bfbb2f5f1f0feef5a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:02.689909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.690851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-28d6936e-4317-4dea-8bfe-39bc0ff81b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.692999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 965/1928] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:02 2022] DELETE /identity/v3/projects/97876ec7d6444bfbb2f5f1f0feef5a62 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:02.697768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e10f-c7e3-4a7d-8aae-4ab9517b07bb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.698061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e10f-c7e3-4a7d-8aae-4ab9517b07bb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.698339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e10f-c7e3-4a7d-8aae-4ab9517b07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.729500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f506e10f-c7e3-4a7d-8aae-4ab9517b07bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:02.731381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f506e10f-c7e3-4a7d-8aae-4ab9517b07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.752809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:02.753459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.753779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.754067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] PATH_INFO: `/v3/projects/5d31aeb800dc4b5cb7ed0bc7913504e0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.755412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d31aeb800dc4b5cb7ed0bc7913504e0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:02.757312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:02.794536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 966/1929] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:02.807696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.808255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.808644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.816817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d31aeb800dc4b5cb7ed0bc7913504e0', 'request_id': 'req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.823466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d31aeb800dc4b5cb7ed0bc7913504e0', 'request_id': 'req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.833708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:02.834451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d31aeb800dc4b5cb7ed0bc7913504e0', 'request_id': 'req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.835246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.853944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] The token cache is being invalidate because project 5d31aeb800dc4b5cb7ed0bc7913504e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:02.854233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.854887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f87dbd1a-a2dd-497e-bf36-4e54c3eb4a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:02.856464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 964/1930] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:02 2022] DELETE /identity/v3/projects/5d31aeb800dc4b5cb7ed0bc7913504e0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:02.863140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19788-2ff4-447e-8bba-f9409673d484 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.863140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19788-2ff4-447e-8bba-f9409673d484 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.863406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19788-2ff4-447e-8bba-f9409673d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.889775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b6a19788-2ff4-447e-8bba-f9409673d484 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:02.891405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b6a19788-2ff4-447e-8bba-f9409673d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:02.921669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 967/1931] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:02.927095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:02.942112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb1bd8-1949-4d9f-a1e9-b74d9a241da2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:02.952803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:02.954191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:02.954191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:02.954382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:02.956270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:02.958352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:02.960016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:02.979853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 968/1932] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:02.985020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:02.999612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae559169-dc30-4b41-91bc-0c0389ac5b54 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.011251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.011983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.012407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.012812 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.015192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.018727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.021585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 965/1933] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:03.029938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.030988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.031260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.063247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 969/1934] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:02 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:03.068002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.071824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:03.073540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.097798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:03.098403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:03.146381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 966/1935] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:03.151274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.158441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1726-ee11-447a-bada-de09067de4af admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.162292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a5dd-2de6-485f-9693-6bc8945891a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.165553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.166247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.166550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.166828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.167340 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.167524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.168215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.168326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.168581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.169388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:03.169490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.169741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.172069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.184732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 967/1936] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:03.185936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.191253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.199910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 970/1937] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:03.199910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.205130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833503e-2d73-4bb3-a19b-7e0efb298c7c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.210266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.211034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.211396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.211550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] PATH_INFO: `/v3/users/5603def473044dfabc4f944e6cc29712` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.213459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5603def473044dfabc4f944e6cc29712)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.213578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df696-fdc5-47bc-8fd0-2016c3367a21 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.215657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.219301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.220099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.220560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.220982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.221843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.223960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.257070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 971/1938] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:03.257981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.276168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5603def473044dfabc4f944e6cc29712'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:03.284395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5603def473044dfabc4f944e6cc29712'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:03.285298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5603def473044dfabc4f944e6cc29712'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:03.286714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5603def473044dfabc4f944e6cc29712'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:03.306411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5603def473044dfabc4f944e6cc29712'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:03.325066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 968/1939] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:03 2022] DELETE /identity/v3/users/5603def473044dfabc4f944e6cc29712 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:03.326468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.329249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.340877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca57de5-b3d2-407a-a4c9-c7d1c11d6148 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.424411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e9ab-b2cc-4732-af53-f3da7e6cb702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.424618 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc75e78-6224-4eda-86b8-647f18c41cd7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.424975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e9ab-b2cc-4732-af53-f3da7e6cb702 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.425385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e9ab-b2cc-4732-af53-f3da7e6cb702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.425726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e9ab-b2cc-4732-af53-f3da7e6cb702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.426434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82e9ab-b2cc-4732-af53-f3da7e6cb702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.428289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82e9ab-b2cc-4732-af53-f3da7e6cb702 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.430296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.430979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.431284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.431547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.432215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.434167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.440068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 972/1940] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:03.441723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.442016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.442293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.458931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 969/1941] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:03.463172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.463520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:03.464729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.464846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.473443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 973/1942] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:03.474304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.478656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab354-0170-4a5a-9358-3c413b3297f4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.483564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.484584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.484879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.485232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.486058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.487852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.488028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fca2d-0330-4475-aa15-54ebc67254d6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.496326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.497332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.497752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.498184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.499059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.500898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.505409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 970/1943] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:03.506361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.508141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.515734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 974/1944] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:03.515734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.516115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:03.527886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f022f-9899-4e0f-a473-5a74dcce9cf7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.532979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.533675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.533963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.534241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] PATH_INFO: `/v3/projects/4f2b2bcdd0d74285931c38eb0e1be3f8/users/573f00f5af6a4ebfbd932224343db530/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.545192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:03.550369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2b2bcdd0d74285931c38eb0e1be3f8, user_id=573f00f5af6a4ebfbd932224343db530, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.553401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.573081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 975/1945] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:03 2022] PUT /identity/v3/projects/4f2b2bcdd0d74285931c38eb0e1be3f8/users/573f00f5af6a4ebfbd932224343db530/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:03.577841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.578404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457046-3e2a-4849-a54f-58eab002e23c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.641496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862e46-5166-4c1f-a800-8d93444fc765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.642162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e46-5166-4c1f-a800-8d93444fc765 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.642442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e46-5166-4c1f-a800-8d93444fc765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.642725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e46-5166-4c1f-a800-8d93444fc765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.648264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21e0b8-0ac3-4edc-88c6-c6657143c624 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.653349 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.654015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.654300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.654576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.654675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e46-5166-4c1f-a800-8d93444fc765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.655915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.656677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e46-5166-4c1f-a800-8d93444fc765 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.657509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.666859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 971/1946] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:03.668094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.668382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.668784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 976/1947] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:03.668904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.672686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.684558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976817-b473-440b-b1e2-ee84b17a1180 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.690278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b3ae-ea5f-424c-bfb6-bca4f773caab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.690866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b3ae-ea5f-424c-bfb6-bca4f773caab admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.691154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b3ae-ea5f-424c-bfb6-bca4f773caab admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.691437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b3ae-ea5f-424c-bfb6-bca4f773caab admin admin] PATH_INFO: `/v3/projects/a361c5622ec04dc38b27d81f4e48544e/users/e4a30c28a80a40dbaa03553baa564364/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.691542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:03.693015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.703594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 972/1948] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:03.711471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b3ae-ea5f-424c-bfb6-bca4f773caab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a361c5622ec04dc38b27d81f4e48544e, user_id=e4a30c28a80a40dbaa03553baa564364, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.713909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.714848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b3ae-ea5f-424c-bfb6-bca4f773caab admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.716551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.733424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984e10-e582-4fe3-974c-e6e44d2b35c6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.735233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 977/1949] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:03 2022] PUT /identity/v3/projects/a361c5622ec04dc38b27d81f4e48544e/users/e4a30c28a80a40dbaa03553baa564364/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:03.746311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.747225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.748166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.812260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.813177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.813676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.814225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.838854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] MFA Rules not processed for user `e4a30c28a80a40dbaa03553baa564364`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:03.840208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:03.906997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:03.908877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:03.925519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 973/1950] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:03.968126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 978/1951] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:03.973688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:03.990992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51861509-2103-450f-ab5b-eae6df4dda15 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:03.996253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:03.996897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:03.997227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:03.997456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:03.999967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.002759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.008859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:04.045034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 974/1952] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:03 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:04.050309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.068570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061e677-f8bf-418f-b464-dca5b2367fc6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.181626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:04.190192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.194285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.195553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.196105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.206708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.208761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.267048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 979/1953] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:04 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:04.268036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.283646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be99240-57e6-452f-98db-efe3f121dc16 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.301204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.302981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.303600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.303889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.304682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.307557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.330608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 975/1954] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:04.335373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.349851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.355020 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1840a-2abb-441d-a2c8-bce2a27f2aa5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.364706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:04.369992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.370632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.370920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.374925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.376154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.379944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.422058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b227df-aa8a-40f7-8241-55db1d175ee8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.425488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 980/1955] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:04.428655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.437314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.439472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.441093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.452931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] PATH_INFO: `/v3/projects/833ab6fde72948b59dcef3836c094c11` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.457773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833ab6fde72948b59dcef3836c094c11)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.460385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.468321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13aaf1-3ef7-4445-8ba3-117fdef9cb2f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.481524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.484472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.484764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.495794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] PATH_INFO: `/v3/projects/8d2c966346c14a19942d34c9857f1050/users/f62d527b5c24477d8f6ed49300a51d34/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.529369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2c966346c14a19942d34c9857f1050, user_id=f62d527b5c24477d8f6ed49300a51d34, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.532676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.569138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 981/1956] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:04 2022] PUT /identity/v3/projects/8d2c966346c14a19942d34c9857f1050/users/f62d527b5c24477d8f6ed49300a51d34/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:04.582270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.583876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:04.584138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833ab6fde72948b59dcef3836c094c11', 'request_id': 'req-7b614aec-3362-47a7-bbd1-6b36bd4a6041'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.600296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833ab6fde72948b59dcef3836c094c11', 'request_id': 'req-7b614aec-3362-47a7-bbd1-6b36bd4a6041'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.620437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833ab6fde72948b59dcef3836c094c11', 'request_id': 'req-7b614aec-3362-47a7-bbd1-6b36bd4a6041'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.644240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] The token cache is being invalidate because project 833ab6fde72948b59dcef3836c094c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:04.644592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.645272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7b614aec-3362-47a7-bbd1-6b36bd4a6041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.651904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 976/1957] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:04 2022] DELETE /identity/v3/projects/833ab6fde72948b59dcef3836c094c11 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:04.653924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.654502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.654857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.697778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] MFA Rules not processed for user `f62d527b5c24477d8f6ed49300a51d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:04.699395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:04.706627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34118e0-a9e7-4666-97b4-2b019502387d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.734130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.735513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.737361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.739223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] PATH_INFO: `/v3/users/f473a1d25c7049e1b4ba067e9b08fb5e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.744805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f473a1d25c7049e1b4ba067e9b08fb5e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.753443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.867147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f473a1d25c7049e1b4ba067e9b08fb5e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.871343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 977/1958] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:04.872771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.877438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f473a1d25c7049e1b4ba067e9b08fb5e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.878359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f473a1d25c7049e1b4ba067e9b08fb5e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.878491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:04.879054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f473a1d25c7049e1b4ba067e9b08fb5e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.900824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f473a1d25c7049e1b4ba067e9b08fb5e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:04.905093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1037dd-cb6a-4cdb-9037-487508c66500 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:04.911878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:04.913051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:04.913739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:04.914224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] PATH_INFO: `/v3/users/f50b9ed0c45d4458b2092f9a9f614185` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:04.916456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50b9ed0c45d4458b2092f9a9f614185)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:04.918737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:04.928048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 982/1959] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:04 2022] DELETE /identity/v3/users/f473a1d25c7049e1b4ba067e9b08fb5e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:04.928048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:04.934510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:04.983099 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:05.001417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:05.007333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50b9ed0c45d4458b2092f9a9f614185'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.015987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50b9ed0c45d4458b2092f9a9f614185'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.017232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50b9ed0c45d4458b2092f9a9f614185'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.017378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50b9ed0c45d4458b2092f9a9f614185'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.032034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ee5ad-9766-4d25-b7ff-9d5c264f538a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.032225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f06cd994-3fb1-4944-a21d-70055a05bcfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50b9ed0c45d4458b2092f9a9f614185'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.038336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.039043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.039378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.039684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.040363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.042324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.049175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 978/1960] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:04 2022] DELETE /identity/v3/users/f50b9ed0c45d4458b2092f9a9f614185 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:05.055417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.055769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.056001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.072038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 983/1961] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:04 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:05.078206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.078348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:05.079608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.079821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.158897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 979/1962] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:05.171525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.172976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.173397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdad8d-46c8-4c1a-a9dd-6252a93de753 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.179463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.180742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.180742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.180742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.181326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.183655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.210092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 984/1963] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:05.214202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.225882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eebebd-1dab-43fa-8d49-bc47cd79ad1c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.230892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.231528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.231797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.232117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.233980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.235997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.246405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456493eb-82cf-430c-a49a-31b694712b10 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.250304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284993e1-fee0-4058-b06d-9881e4687035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.250944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284993e1-fee0-4058-b06d-9881e4687035 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.251228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284993e1-fee0-4058-b06d-9881e4687035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.251581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284993e1-fee0-4058-b06d-9881e4687035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.253523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 985/1964] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:05.254033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.267354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284993e1-fee0-4058-b06d-9881e4687035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.268852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bc8db-8e1e-4ffa-9386-204bda6b67fa admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.269889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284993e1-fee0-4058-b06d-9881e4687035 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.276222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.277157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.277867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.278213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] PATH_INFO: `/v3/projects/11b051f209184cfb8e861ecfe0694b0f/users/a1121e4dcd474bfe95640785d470ca6d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.287344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 980/1965] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:05.304078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.305342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.305664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.331483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b051f209184cfb8e861ecfe0694b0f, user_id=a1121e4dcd474bfe95640785d470ca6d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.338494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.371453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 986/1966] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:05 2022] PUT /identity/v3/projects/11b051f209184cfb8e861ecfe0694b0f/users/a1121e4dcd474bfe95640785d470ca6d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:05.372413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.382103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] MFA Rules not processed for user `573f00f5af6a4ebfbd932224343db530`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:05.385179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.465496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf7922-8c25-4999-a57b-02a5c7a66223 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.473471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.475861 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.476324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.476439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.477146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.478770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.486276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:05.489278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:05.493377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 987/1967] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:05.496725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.499578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.523524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ddc3e-e177-4f3a-b7d2-af513887f8fb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.523772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 981/1968] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:05.524599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.536110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.536830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.537181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.537401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] PATH_INFO: `/v3/projects/09f8cc06e2374891b4bbacf0c023b6e9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.537529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2251fe-4b47-4356-819e-a222ba037a92 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.538897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f8cc06e2374891b4bbacf0c023b6e9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.540961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.543251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.543978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.544335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.544954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] PATH_INFO: `/v3/projects/11b051f209184cfb8e861ecfe0694b0f/users/a1121e4dcd474bfe95640785d470ca6d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.547888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b051f209184cfb8e861ecfe0694b0f, user_id=a1121e4dcd474bfe95640785d470ca6d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.550623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.563747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 982/1969] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:05 2022] PUT /identity/v3/projects/11b051f209184cfb8e861ecfe0694b0f/users/a1121e4dcd474bfe95640785d470ca6d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:05.564927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.566633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.650713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f8cc06e2374891b4bbacf0c023b6e9', 'request_id': 'req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.658685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f8cc06e2374891b4bbacf0c023b6e9', 'request_id': 'req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.662994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2c9f9-99f8-40dc-a7f0-0c917e63b6d4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.666039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f8cc06e2374891b4bbacf0c023b6e9', 'request_id': 'req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.684506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] The token cache is being invalidate because project 09f8cc06e2374891b4bbacf0c023b6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:05.684824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.685547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b39a2b-5b70-489f-ab36-6e0ad67e5ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:05.687525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 988/1970] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:05 2022] DELETE /identity/v3/projects/09f8cc06e2374891b4bbacf0c023b6e9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:05.689095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154836-07a6-4440-93af-008e003bfc12 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.689531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154836-07a6-4440-93af-008e003bfc12 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.689846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154836-07a6-4440-93af-008e003bfc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.726405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-14154836-07a6-4440-93af-008e003bfc12 None None] MFA Rules not processed for user `a1121e4dcd474bfe95640785d470ca6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:05.728537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-14154836-07a6-4440-93af-008e003bfc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.754919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595023-e571-4cb1-af60-9599315eb042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.755953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595023-e571-4cb1-af60-9599315eb042 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.756247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595023-e571-4cb1-af60-9599315eb042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.756533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595023-e571-4cb1-af60-9599315eb042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.757689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595023-e571-4cb1-af60-9599315eb042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.759757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595023-e571-4cb1-af60-9599315eb042 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.807757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 983/1971] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/projects => generated 369 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:05.809564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.809923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.810755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.836934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:05.838731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.839647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 989/1972] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:05.840747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154836-07a6-4440-93af-008e003bfc12 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.859247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-14154836-07a6-4440-93af-008e003bfc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.877110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154836-07a6-4440-93af-008e003bfc12 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.958839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 984/1973] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:05.963457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:05.965845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:05.987370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bcadf-28f4-4a44-a774-8f6943cc87ca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:05.993716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.994313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:05.994438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.994863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.994987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:05.995281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:05.995380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] PATH_INFO: `/v3/projects/b7c0ff4e7941483c9366710fac7d1a57` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.995578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:05.996248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.996722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c0ff4e7941483c9366710fac7d1a57)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:05.998305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:05.999361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.012319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:06.016558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:06.035122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 985/1974] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:05 2022] POST /identity/v3/users => generated 291 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:06.035918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.038194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.078013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c0ff4e7941483c9366710fac7d1a57', 'request_id': 'req-e552558f-0a60-4393-9efa-bdad22b1f075'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.086032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c0ff4e7941483c9366710fac7d1a57', 'request_id': 'req-e552558f-0a60-4393-9efa-bdad22b1f075'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.093399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c0ff4e7941483c9366710fac7d1a57', 'request_id': 'req-e552558f-0a60-4393-9efa-bdad22b1f075'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.111621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] The token cache is being invalidate because project b7c0ff4e7941483c9366710fac7d1a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:06.111869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5c212-76eb-4dfb-8ee4-09e38b6b4e83 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.112092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.112962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e552558f-0a60-4393-9efa-bdad22b1f075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.115954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 990/1975] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:05 2022] DELETE /identity/v3/projects/b7c0ff4e7941483c9366710fac7d1a57 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:06.117241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.117589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.117984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.141548 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:06.143082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.194351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.194987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.195304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.196121 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.198012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.243823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 991/1976] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:06.245365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.246855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.262872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b2280-f4a7-4e8c-997b-e5c17b48167d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.269065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.269892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.270395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.271010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.271680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.273384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.274838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.277254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.288151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 992/1977] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:06.288806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.290631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 986/1978] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:06.291248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.291606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.305753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdccf-ff9f-492a-a346-5d4f0202e2f9 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.308449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ab20-9316-4cbe-9da2-6802c9d6c2a7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.311714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.312608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.313540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.313922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.314680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.314826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:06.315144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.315709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.316078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.316431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] PATH_INFO: `/v3/users/b2153b6563e8494f9c230133e4a66ddd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.318090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.322311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2153b6563e8494f9c230133e4a66ddd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.324509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.352614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 987/1979] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:06.352614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.363656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a386e3-fbf5-4d84-8095-8124897c61ae admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.370126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.370644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.370980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.371268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] PATH_INFO: `/v3/projects/e8c2c4c8903841fdab861aa4d8543dbd/users/c322985d388b40c286837cab551d6d9c/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.391289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c2c4c8903841fdab861aa4d8543dbd, user_id=c322985d388b40c286837cab551d6d9c, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.395474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.410083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2153b6563e8494f9c230133e4a66ddd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.415595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 988/1980] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:06 2022] PUT /identity/v3/projects/e8c2c4c8903841fdab861aa4d8543dbd/users/c322985d388b40c286837cab551d6d9c/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:06.416736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.423917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2153b6563e8494f9c230133e4a66ddd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.424859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2153b6563e8494f9c230133e4a66ddd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.425741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2153b6563e8494f9c230133e4a66ddd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.439462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2153b6563e8494f9c230133e4a66ddd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:06.454551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:06.459345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:06.460467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 993/1981] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:06 2022] DELETE /identity/v3/users/b2153b6563e8494f9c230133e4a66ddd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:06.462189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.464189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.513569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663986e1-ece0-4f08-9d59-156654e5c5a6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.561985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2169b78-00bb-4436-a829-bdc73f2ad798 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.570986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.571705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.572062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.572339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.573040 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.574675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.589405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 994/1982] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:06.590341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.603661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.604411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.604696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.604970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.605764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.605979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c88d-320f-4292-828f-607e50991636 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.608057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.614096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.615325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.615716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.616102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] PATH_INFO: `/v3/projects/e8c2c4c8903841fdab861aa4d8543dbd/users/c322985d388b40c286837cab551d6d9c/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.620610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c2c4c8903841fdab861aa4d8543dbd, user_id=c322985d388b40c286837cab551d6d9c, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.625351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.640130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 995/1983] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:06 2022] PUT /identity/v3/projects/e8c2c4c8903841fdab861aa4d8543dbd/users/c322985d388b40c286837cab551d6d9c/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:06.661946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 989/1984] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:06 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:06.665887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.667602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:06.814068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6d892-b072-41a9-a46c-f9dde8d51cb9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:06.899496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:06.900137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:06.900424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:06.900714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:06.901641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:06.903425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:06.956934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 996/1985] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:06 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:06.961384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:06.976086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82102179-b501-473f-946b-fd3136e8154c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.005417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.006562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.006911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.007199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.007964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.012855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.042412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 990/1986] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:07.046511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.060087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f5728-ba89-4c84-8e94-ffefefe20bc7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.066802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.067431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.067718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.068058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.069094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.070945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.079099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.086453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 997/1987] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:07.087930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:07.094482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.110371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a0105-5c42-4dbb-b416-195dd925e652 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.118353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75fc39-c311-4865-9acb-b636617975e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.119257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fc39-c311-4865-9acb-b636617975e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.119673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fc39-c311-4865-9acb-b636617975e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.120026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fc39-c311-4865-9acb-b636617975e7 admin admin] PATH_INFO: `/v3/projects/b4e596f1df534e1aad0eb28ee4dfa694/users/cf3049230cd04bdd89ba14e2ff3dfd2d/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.129374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:07.144593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323684-298f-49cb-9c92-cecd31db200b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.152211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fc39-c311-4865-9acb-b636617975e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e596f1df534e1aad0eb28ee4dfa694, user_id=cf3049230cd04bdd89ba14e2ff3dfd2d, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.155626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fc39-c311-4865-9acb-b636617975e7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.164201 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.164954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.165243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.165622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] PATH_INFO: `/v3/projects/cdb90d0847474c859b083473bc812531` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.167020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb90d0847474c859b083473bc812531)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.169164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.179235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 998/1988] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:07 2022] PUT /identity/v3/projects/b4e596f1df534e1aad0eb28ee4dfa694/users/cf3049230cd04bdd89ba14e2ff3dfd2d/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:07.204789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.205357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.205810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.240221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] MFA Rules not processed for user `cf3049230cd04bdd89ba14e2ff3dfd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:07.241495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:07.250406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb90d0847474c859b083473bc812531', 'request_id': 'req-28f6cab1-435c-4d86-85d2-c2e4678c0878'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:07.258233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb90d0847474c859b083473bc812531', 'request_id': 'req-28f6cab1-435c-4d86-85d2-c2e4678c0878'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:07.269820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb90d0847474c859b083473bc812531', 'request_id': 'req-28f6cab1-435c-4d86-85d2-c2e4678c0878'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:07.315867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] The token cache is being invalidate because project cdb90d0847474c859b083473bc812531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:07.319818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:07.323317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-28f6cab1-435c-4d86-85d2-c2e4678c0878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:07.326541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 991/1989] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:07 2022] DELETE /identity/v3/projects/cdb90d0847474c859b083473bc812531 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:07.333080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c530b-4491-49e7-8ba3-869d7fabfe93 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.333080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c530b-4491-49e7-8ba3-869d7fabfe93 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.333080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c530b-4491-49e7-8ba3-869d7fabfe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.344572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 999/1990] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:07.358942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.360714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:07.374471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e95c530b-4491-49e7-8ba3-869d7fabfe93 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:07.377773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e95c530b-4491-49e7-8ba3-869d7fabfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:07.426216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:07.466411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c609dc-eeb2-496e-a55d-dd32c06736c6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.471112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 992/1991] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:07.471950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.472687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.473062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.473412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.474201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.476259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.480031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.480333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.481031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.508409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:07.510130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:07.511000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1000/1992] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:07.515275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.589701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 993/1993] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:07.591307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.593917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411f6d2-6985-407d-b825-66558e032544 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.599564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.600388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.600571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.600811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.601524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.603608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.613882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:07.616668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97a14-6f8c-4303-b648-8a866c133d5c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.622949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.624459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.624768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.625170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.626067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:07.626385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.628140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.635607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1001/1994] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:07.640538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.645776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 994/1995] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:44:07.646630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.654411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a305c1-c683-4966-8c15-8d3dbac27845 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.657580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017f6ec-9481-4405-a8bb-0e014b6a4603 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.659795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.660594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.660880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.661157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.662067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.663046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.663691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.663818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.664519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.664519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.665248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.667344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.677635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1002/1996] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:07.681528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.694713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd585a-5817-437f-abb9-69db18741658 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.700756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.701508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.705562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.705730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 995/1997] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:07.705827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] PATH_INFO: `/v3/projects/0f7b4195a3714857b29679626c4b085d/users/a6c70aad2aa3482fa9ec209dbb677450/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.707706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.724173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7b4195a3714857b29679626c4b085d, user_id=a6c70aad2aa3482fa9ec209dbb677450, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.727080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.745642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1003/1998] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:07 2022] PUT /identity/v3/projects/0f7b4195a3714857b29679626c4b085d/users/a6c70aad2aa3482fa9ec209dbb677450/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:07.749965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.803487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf8354-3617-4f96-9f25-4fbbd2962a5c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.858949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85b501-a848-49bc-9b3a-3333c3b301cb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.865027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b59e5-91ce-4c89-bee6-fe22eb523722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.865721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b59e5-91ce-4c89-bee6-fe22eb523722 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.866069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b59e5-91ce-4c89-bee6-fe22eb523722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.866424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b59e5-91ce-4c89-bee6-fe22eb523722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.867377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b59e5-91ce-4c89-bee6-fe22eb523722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.869873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b59e5-91ce-4c89-bee6-fe22eb523722 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.881739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1004/1999] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:07.882834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482ecf-e9d8-42b4-af3b-fc9f5951ab9a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.883127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482ecf-e9d8-42b4-af3b-fc9f5951ab9a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.883412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f482ecf-e9d8-42b4-af3b-fc9f5951ab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.897481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:07.918987 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.919729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.920090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.920442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.921348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4f482ecf-e9d8-42b4-af3b-fc9f5951ab9a None None] MFA Rules not processed for user `c322985d388b40c286837cab551d6d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:07.921851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.923114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4f482ecf-e9d8-42b4-af3b-fc9f5951ab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:07.924106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.952740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 996/2000] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:07.958538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:07.965273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6774f44-54d4-421f-a75d-25f6e4e1e9b5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:07.970740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:07.971754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:07.971931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:07.972253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] PATH_INFO: `/v3/projects/0f7b4195a3714857b29679626c4b085d/users/a6c70aad2aa3482fa9ec209dbb677450/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:07.974390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7b4195a3714857b29679626c4b085d, user_id=a6c70aad2aa3482fa9ec209dbb677450, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:07.977250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:07.991324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 997/2001] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:07 2022] PUT /identity/v3/projects/0f7b4195a3714857b29679626c4b085d/users/a6c70aad2aa3482fa9ec209dbb677450/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:07.992231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.049739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1005/2002] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:08.051217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea92c7-7d29-4f86-8f42-7b7d86bebff1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.051434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea92c7-7d29-4f86-8f42-7b7d86bebff1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.052338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea92c7-7d29-4f86-8f42-7b7d86bebff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.069856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150937-8382-42ad-9cee-4f2f63767296 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.076577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.077330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.077651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.077940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.078710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.080773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.083341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-27ea92c7-7d29-4f86-8f42-7b7d86bebff1 None None] MFA Rules not processed for user `a6c70aad2aa3482fa9ec209dbb677450`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:08.084567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-27ea92c7-7d29-4f86-8f42-7b7d86bebff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.091250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 998/2003] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:08.094983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.096670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.112337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:08.171820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1006/2004] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:08.171997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825cb8f-1d75-48c0-b3cb-5a1587281a93 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.172082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.172082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.172082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.182782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.183279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.183561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.183838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.185971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.198532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] MFA Rules not processed for user `573f00f5af6a4ebfbd932224343db530`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:08.199848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.273881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1007/2005] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:08.275574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.290638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bd200-45e3-4654-b145-9604f7244c37 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.292708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.297903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.298041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.298746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.299240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.299600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.300383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.303021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.309337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 999/2006] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:08.321279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.322598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1008/2007] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:08.323572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.324828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.335318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ad647-aafc-4777-9c20-3d22df8d8e15 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.345392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb057-770a-4b2b-a71c-a7767cd77d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.345392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb057-770a-4b2b-a71c-a7767cd77d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.345714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb057-770a-4b2b-a71c-a7767cd77d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.346865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb057-770a-4b2b-a71c-a7767cd77d43 admin admin] PATH_INFO: `/v3/projects/175787fb98c448e38f8317d60016bc20/users/440d1dc994b44d9a9fce5f603a087fb8/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.355030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ab04-531b-46db-baf6-841afcfdc4a6 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.361509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.362583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.363155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.370007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.388670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb057-770a-4b2b-a71c-a7767cd77d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175787fb98c448e38f8317d60016bc20, user_id=440d1dc994b44d9a9fce5f603a087fb8, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.399132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.400977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.401991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb057-770a-4b2b-a71c-a7767cd77d43 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.406102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:08.415004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1000/2008] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:08.415750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.420249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.429278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1009/2009] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:08 2022] PUT /identity/v3/projects/175787fb98c448e38f8317d60016bc20/users/440d1dc994b44d9a9fce5f603a087fb8/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:08.448601 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.448965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.449255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.505398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] MFA Rules not processed for user `440d1dc994b44d9a9fce5f603a087fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:08.507778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.593509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474b616-491d-453a-809f-9a5722b07254 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.599396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1010/2010] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:08.599396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.625800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:08.687475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6f808-0fdd-4880-9de3-dd51309b672b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.695043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.695677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.695961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.696235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.721624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.722343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.722678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.722962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.725154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:08.784200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.786907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.814151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1011/2011] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:08.814281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.815506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.816977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.841031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1001/2012] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:08.921767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692aa8-170b-4301-aaf6-ea669a10d19b service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:08.932766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:08.933413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:08.935499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:08.935794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:08.937075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:08.939160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:08.978927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1012/2013] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:08 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:08.980200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:08.995959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445f123-8dc6-41c6-b1d3-570852f45c71 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.049860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:09.101621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.101621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.101621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.101621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.102212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.102212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.133067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1002/2014] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:08 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:09.141265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.156756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.163571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ab35-2daa-4f6b-82f1-24b602000c81 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.170425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.171475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.171994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.172425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.173332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.177676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.227688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1013/2015] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:09.234321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.250120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728606-55d5-4d3d-b7d0-2aee1c4668cd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.256074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1c832-ce26-4164-a21b-56a5efef2e3a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.259891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.260452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.260754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.261176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.266292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:09.268858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.269615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.269962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.270247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] PATH_INFO: `/v3/projects/5e81f1984a7c43939f756049b62478b7/users/7bb0e069c2a2444f8fd1bec31e2bc6c6/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.319378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e81f1984a7c43939f756049b62478b7, user_id=7bb0e069c2a2444f8fd1bec31e2bc6c6, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.320896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.343785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1014/2016] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:09 2022] PUT /identity/v3/projects/5e81f1984a7c43939f756049b62478b7/users/7bb0e069c2a2444f8fd1bec31e2bc6c6/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:09.348431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.395997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:09.417461 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.419007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.430628 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1003/2017] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:09.452015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34ace-c7c7-4a2d-a6d2-07e3ee817372 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.457654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02446-ba23-416d-a607-9a8ba82c760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.458324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02446-ba23-416d-a607-9a8ba82c760b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.459921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02446-ba23-416d-a607-9a8ba82c760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.459921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02446-ba23-416d-a607-9a8ba82c760b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.459921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02446-ba23-416d-a607-9a8ba82c760b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.462088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02446-ba23-416d-a607-9a8ba82c760b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.475759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1015/2018] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:09.479707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.497879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe0afa-8bb0-44fa-bbd2-64b599d4db1a service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.512544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.513716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.514153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.514637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] PATH_INFO: `/v3/projects/5e81f1984a7c43939f756049b62478b7/users/7bb0e069c2a2444f8fd1bec31e2bc6c6/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.520135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e81f1984a7c43939f756049b62478b7, user_id=7bb0e069c2a2444f8fd1bec31e2bc6c6, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.527103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.543405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1004/2019] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:09 2022] PUT /identity/v3/projects/5e81f1984a7c43939f756049b62478b7/users/7bb0e069c2a2444f8fd1bec31e2bc6c6/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:09.555386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.555680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.555959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.607636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] MFA Rules not processed for user `7bb0e069c2a2444f8fd1bec31e2bc6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:09.610210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:09.769848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1016/2020] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:09.786709 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.865566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29febec3-e2d0-4ae1-be40-50d2f2667ad3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.870886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.871512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.872152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.872278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:09.883780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:09.885214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:09.896419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1005/2021] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:09.953758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:09.966325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b63a-b162-486b-b1dc-9ba380f10652 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:09.972329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:09.974120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:09.974806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:09.975614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:10.109235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:10.111203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:10.124551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1017/2022] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:13.732279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:13.734523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:13.740926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:13.760764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:13.811994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:13.828795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f7168-10ab-42b4-be80-f029eabde1d2 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:13.835206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08accffa-349d-4475-a420-21d1b4ee4b48 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:13.837068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:13.837869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:13.838287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:13.838667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] PATH_INFO: `/v3/users/e4a30c28a80a40dbaa03553baa564364` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:13.840006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a30c28a80a40dbaa03553baa564364)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:13.840252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:13.840898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:13.841236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:13.841521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] PATH_INFO: `/v3/users/440d1dc994b44d9a9fce5f603a087fb8` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:13.843106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:13.843364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440d1dc994b44d9a9fce5f603a087fb8)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:13.845302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:13.919015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a30c28a80a40dbaa03553baa564364'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.935395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a30c28a80a40dbaa03553baa564364'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.936404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a30c28a80a40dbaa03553baa564364'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.937405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a30c28a80a40dbaa03553baa564364'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.945879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440d1dc994b44d9a9fce5f603a087fb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.957342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440d1dc994b44d9a9fce5f603a087fb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.966461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440d1dc994b44d9a9fce5f603a087fb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.969778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440d1dc994b44d9a9fce5f603a087fb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:13.981560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-392f9a14-11c2-4b12-879f-781864ef3650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a30c28a80a40dbaa03553baa564364'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.001648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f58b7a7b-52f5-4f80-b3dd-5f28076291d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440d1dc994b44d9a9fce5f603a087fb8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.028817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1006/2024] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:13 2022] DELETE /identity/v3/users/e4a30c28a80a40dbaa03553baa564364 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:14.030671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1018/2024] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:13 2022] DELETE /identity/v3/users/440d1dc994b44d9a9fce5f603a087fb8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:14.033178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.033671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.034001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.034290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.034395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.034648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.060302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:14.061806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.080806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:14.082060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.165517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1019/2025] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:14.183502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:14.185482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.208205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1007/2026] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:14.209343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:14.211092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.248440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:14.286070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bfea1-bfa4-433c-9308-62bbbe227e9c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:14.294467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:14.295114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.295439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.295872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.309305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:14.316301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81988-d0f4-42c7-914c-e278804d1310 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:14.319333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:14.322617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36d530-5db2-4ed7-820c-28b87c33316d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:14.324433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36d530-5db2-4ed7-820c-28b87c33316d service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.324433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36d530-5db2-4ed7-820c-28b87c33316d service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.324645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36d530-5db2-4ed7-820c-28b87c33316d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.334368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1020/2027] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:14.339403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36d530-5db2-4ed7-820c-28b87c33316d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:14.341637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36d530-5db2-4ed7-820c-28b87c33316d service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:14.356980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1008/2028] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:14.388487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:14.390933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.406181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4604-248e-4bea-a574-6a7a4a6c1557 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:14.412073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:14.413127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.413658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.414146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] PATH_INFO: `/v3/users/cf3049230cd04bdd89ba14e2ff3dfd2d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.415945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3049230cd04bdd89ba14e2ff3dfd2d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:14.418595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:14.421116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:14.518995 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3049230cd04bdd89ba14e2ff3dfd2d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.533189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3049230cd04bdd89ba14e2ff3dfd2d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.535121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3049230cd04bdd89ba14e2ff3dfd2d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.539003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3049230cd04bdd89ba14e2ff3dfd2d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.567201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3049230cd04bdd89ba14e2ff3dfd2d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:14.607093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1021/2029] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:14 2022] DELETE /identity/v3/users/cf3049230cd04bdd89ba14e2ff3dfd2d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:14.612257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.612435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.612719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.641428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:14.643600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.730003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1009/2030] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:14.745560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:14.747357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.817668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b33403-5157-4b36-b588-4f7b40200e63 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:14.821730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:14.822362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.822652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.822930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.832857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:14.834365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:14.853411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1022/2031] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:14.948299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:14.948299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:14.973627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2d53-4972-4c5b-aa9c-1c34ace6bccb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:14.980166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:14.980166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:14.980166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:14.980482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] PATH_INFO: `/v3/projects/a361c5622ec04dc38b27d81f4e48544e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:14.992202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a361c5622ec04dc38b27d81f4e48544e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:14.994906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:15.060002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a361c5622ec04dc38b27d81f4e48544e', 'request_id': 'req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.061562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:15.063355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:15.068416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a361c5622ec04dc38b27d81f4e48544e', 'request_id': 'req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.076302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a361c5622ec04dc38b27d81f4e48544e', 'request_id': 'req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.089337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801439a-6b4a-4fd7-bbc6-8399ee4d7112 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:15.095293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] The token cache is being invalidate because project a361c5622ec04dc38b27d81f4e48544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:15.114169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.122260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.130135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1010/2032] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:14 2022] DELETE /identity/v3/projects/a361c5622ec04dc38b27d81f4e48544e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:15.134262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:15.136398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:15.234015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:15.247826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:15.250089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:15.253287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:15.254022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] PATH_INFO: `/v3/projects/175787fb98c448e38f8317d60016bc20` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:15.257033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=175787fb98c448e38f8317d60016bc20)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:15.260123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d90c-5495-4d5d-acf6-ba0dad9bbef2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:15.263687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:15.267694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:15.268725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:15.269274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:15.269579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] PATH_INFO: `/v3/users/f62d527b5c24477d8f6ed49300a51d34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:15.270999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62d527b5c24477d8f6ed49300a51d34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:15.273927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:15.318392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:15.354596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62d527b5c24477d8f6ed49300a51d34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.366324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62d527b5c24477d8f6ed49300a51d34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.367835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62d527b5c24477d8f6ed49300a51d34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.368704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175787fb98c448e38f8317d60016bc20', 'request_id': 'req-23799e66-840c-4536-aaa2-ca2916afb8b8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.369362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62d527b5c24477d8f6ed49300a51d34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.379982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175787fb98c448e38f8317d60016bc20', 'request_id': 'req-23799e66-840c-4536-aaa2-ca2916afb8b8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.388646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175787fb98c448e38f8317d60016bc20', 'request_id': 'req-23799e66-840c-4536-aaa2-ca2916afb8b8'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.390714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62d527b5c24477d8f6ed49300a51d34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.425015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1011/2033] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:15 2022] DELETE /identity/v3/users/f62d527b5c24477d8f6ed49300a51d34 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:15.431046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] The token cache is being invalidate because project 175787fb98c448e38f8317d60016bc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:15.431631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.433071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.436309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1023/2034] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:15 2022] DELETE /identity/v3/projects/175787fb98c448e38f8317d60016bc20 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:15.441460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:15.443169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:15.538174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200df4-06c7-4187-aa26-9cda2cb5eae1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:15.543710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:15.544411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:15.544696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:15.544977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] PATH_INFO: `/v3/users/7bb0e069c2a2444f8fd1bec31e2bc6c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:15.546606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb0e069c2a2444f8fd1bec31e2bc6c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:15.549642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:15.622548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb0e069c2a2444f8fd1bec31e2bc6c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.633328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb0e069c2a2444f8fd1bec31e2bc6c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.634236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb0e069c2a2444f8fd1bec31e2bc6c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.635393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb0e069c2a2444f8fd1bec31e2bc6c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.648643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:15.651382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb0e069c2a2444f8fd1bec31e2bc6c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:15.691782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1012/2035] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:15 2022] DELETE /identity/v3/users/7bb0e069c2a2444f8fd1bec31e2bc6c6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:16.016355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:16.019131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:16.124098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799e66-840c-4536-aaa2-ca2916afb8b8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:16.252942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:16.253644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:16.253937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:16.254218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] PATH_INFO: `/v3/projects/b4e596f1df534e1aad0eb28ee4dfa694` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:16.255427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e596f1df534e1aad0eb28ee4dfa694)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:16.258351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:16.320023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e596f1df534e1aad0eb28ee4dfa694', 'request_id': 'req-cfd0fda3-8717-4b02-8b14-77828de7b692'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.327574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e596f1df534e1aad0eb28ee4dfa694', 'request_id': 'req-cfd0fda3-8717-4b02-8b14-77828de7b692'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.335322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:16.336809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e596f1df534e1aad0eb28ee4dfa694', 'request_id': 'req-cfd0fda3-8717-4b02-8b14-77828de7b692'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.361216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:16.362958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:16.363323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] The token cache is being invalidate because project b4e596f1df534e1aad0eb28ee4dfa694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:16.363775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.364855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.367240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1024/2036] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:16 2022] DELETE /identity/v3/projects/b4e596f1df534e1aad0eb28ee4dfa694 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:16.371542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:16.374351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:16.388161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e5424-eff0-44a2-ad2b-a8bd2b61ae7a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:16.490724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0fda3-8717-4b02-8b14-77828de7b692 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:16.497860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:16.498579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:16.498851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:16.499131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] PATH_INFO: `/v3/users/a6c70aad2aa3482fa9ec209dbb677450` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:16.500411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c70aad2aa3482fa9ec209dbb677450)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:16.502363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:16.510252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:16.510949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:16.511234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:16.511626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] PATH_INFO: `/v3/projects/8d2c966346c14a19942d34c9857f1050` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:16.519688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2c966346c14a19942d34c9857f1050)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:16.519688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:16.595373 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c70aad2aa3482fa9ec209dbb677450'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.601212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2c966346c14a19942d34c9857f1050', 'request_id': 'req-42405e0d-b104-47a4-88c5-17ecea782ba4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.605712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c70aad2aa3482fa9ec209dbb677450'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.607137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c70aad2aa3482fa9ec209dbb677450'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.608868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c70aad2aa3482fa9ec209dbb677450'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.609556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2c966346c14a19942d34c9857f1050', 'request_id': 'req-42405e0d-b104-47a4-88c5-17ecea782ba4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.617017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2c966346c14a19942d34c9857f1050', 'request_id': 'req-42405e0d-b104-47a4-88c5-17ecea782ba4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.627850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c70aad2aa3482fa9ec209dbb677450'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.633773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] The token cache is being invalidate because project 8d2c966346c14a19942d34c9857f1050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:16.634077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.648453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.651085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1013/2037] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:16 2022] DELETE /identity/v3/projects/8d2c966346c14a19942d34c9857f1050 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:16.651676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:16.653516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:16.658803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1025/2038] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:16 2022] DELETE /identity/v3/users/a6c70aad2aa3482fa9ec209dbb677450 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:16.663708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:16.666233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:16.832614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca50446-1c9c-4e9a-b6cf-dc0edf1d7bbd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:16.843167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42405e0d-b104-47a4-88c5-17ecea782ba4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:16.843798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:16.845344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:16.845657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:16.846233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] PATH_INFO: `/v3/users/a1121e4dcd474bfe95640785d470ca6d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:16.847952 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1121e4dcd474bfe95640785d470ca6d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:16.853281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:16.858277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:16.860150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:16.860603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:16.861037 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] PATH_INFO: `/v3/projects/5e81f1984a7c43939f756049b62478b7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:16.864521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e81f1984a7c43939f756049b62478b7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:16.867551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:16.872791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:16.922214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:16.963837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e81f1984a7c43939f756049b62478b7', 'request_id': 'req-8ea87714-019e-49b5-b2ce-74f52bb3e651'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.973578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e81f1984a7c43939f756049b62478b7', 'request_id': 'req-8ea87714-019e-49b5-b2ce-74f52bb3e651'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:16.983135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e81f1984a7c43939f756049b62478b7', 'request_id': 'req-8ea87714-019e-49b5-b2ce-74f52bb3e651'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.001766 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] The token cache is being invalidate because project 5e81f1984a7c43939f756049b62478b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:17.002005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.003345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8ea87714-019e-49b5-b2ce-74f52bb3e651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.006119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1014/2039] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:16 2022] DELETE /identity/v3/projects/5e81f1984a7c43939f756049b62478b7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:17.013076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.013587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.014818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.016295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1121e4dcd474bfe95640785d470ca6d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.032071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1121e4dcd474bfe95640785d470ca6d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.032868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1121e4dcd474bfe95640785d470ca6d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.033514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1121e4dcd474bfe95640785d470ca6d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.046742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:17.048221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:17.058820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1c0611bc-9629-4de4-b0c2-5874d495b1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1121e4dcd474bfe95640785d470ca6d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.082391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1026/2040] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:16 2022] DELETE /identity/v3/users/a1121e4dcd474bfe95640785d470ca6d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:17.142228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1015/2041] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:17.150563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.150934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.151222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.171899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:17.173053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:17.236437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1027/2042] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:17.240877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.252931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7bd9a-cc68-44ab-997e-af4e84db08ff None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.258886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.259694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.260047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.260395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.261168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:17.261549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.263259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.280874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1016/2043] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:17.285456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.295735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff8716-f042-46dd-9a5c-923d11ba9bcf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.301551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.302593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.302980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.303361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.304140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.306229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.343043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1028/2044] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:17 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:17.347072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.376995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e33b52-9a72-460b-a5da-544ad81d2bc3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.503562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.505523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.505523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.507216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.507976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.510568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.547339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1017/2045] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:17 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:17.552919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.570615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd59787-9e5a-418d-bcab-bab9d9410af0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.583399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.585668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.587182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.587662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.588986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.593340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.606881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1029/2046] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:17.611804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.641770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314805-603a-4197-8e62-0ba38dcc09d4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.651048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.652748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.653560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.654179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.655000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.659555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.680675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1018/2047] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:17.681868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.682188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:17.684403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:17.708844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37c729-de0f-4fef-a6ad-646a0b31184b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.709364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c69d-4dd6-42ea-b962-fb58a0f758a3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:17.721128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.722019 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.722420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.722750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] PATH_INFO: `/v3/projects/0f7b4195a3714857b29679626c4b085d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.725286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7b4195a3714857b29679626c4b085d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.727436 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.738136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49e48f-ab2e-49e8-8a29-a1837fe142f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:17.738838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e48f-ab2e-49e8-8a29-a1837fe142f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.741812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e48f-ab2e-49e8-8a29-a1837fe142f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.742107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e48f-ab2e-49e8-8a29-a1837fe142f4 admin admin] PATH_INFO: `/v3/projects/0ae7a14b253244afb57347d1744edd58/users/f3e166fa55484ea49e09863d7f865c05/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.766066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:17.774735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e48f-ab2e-49e8-8a29-a1837fe142f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae7a14b253244afb57347d1744edd58, user_id=f3e166fa55484ea49e09863d7f865c05, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:17.779489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e48f-ab2e-49e8-8a29-a1837fe142f4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:17.796816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7b4195a3714857b29679626c4b085d', 'request_id': 'req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.798528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:17.809712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1019/2048] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:17 2022] PUT /identity/v3/projects/0ae7a14b253244afb57347d1744edd58/users/f3e166fa55484ea49e09863d7f865c05/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:17.819263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.819549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7b4195a3714857b29679626c4b085d', 'request_id': 'req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.821252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.821742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.833482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7b4195a3714857b29679626c4b085d', 'request_id': 'req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.861806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] The token cache is being invalidate because project 0f7b4195a3714857b29679626c4b085d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:17.862427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.863380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1943243a-c7e3-41b7-8f48-a0f3c38ab03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:17.865508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1030/2049] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:17 2022] DELETE /identity/v3/projects/0f7b4195a3714857b29679626c4b085d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:17.870398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ad6ed-0ef3-4a88-8f78-799937049ad8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:17.870983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ad6ed-0ef3-4a88-8f78-799937049ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:17.871461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ad6ed-0ef3-4a88-8f78-799937049ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:17.872982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] MFA Rules not processed for user `f3e166fa55484ea49e09863d7f865c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:17.875127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:17.895697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-323ad6ed-0ef3-4a88-8f78-799937049ad8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:17.897515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-323ad6ed-0ef3-4a88-8f78-799937049ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:18.012011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1031/2050] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:18.015204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.015331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.015613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.043795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:18.045454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:18.056247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1032/2051] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:18.064263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.074433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1020/2052] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:18.079552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949a750-1ba7-45ae-9caa-9cbfe4ada17e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.080445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.082551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:18.086767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.087725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.088578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.089116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.090379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:18.090943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.093018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.117076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1033/2053] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:18.124452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36319-fdfb-479c-a31b-f543865da82a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.126826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.129713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.130351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.131013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.131300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.132149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.134134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.144094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e07c5a-345d-468b-9c4e-b050f8af4f15 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.154804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.155444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.155737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.156013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.156678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.158637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.167315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1021/2054] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:18 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:18.173010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.224425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1034/2055] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:18 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:18.228451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.292249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8bdd1-1dd2-4816-b796-31a7a0f83763 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.375491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128706-21be-4ed1-9a8c-ba476c1ff390 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.391521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.392198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.392442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.392720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.393413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.395651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.397242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.398172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.398686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.399172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.400048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.402219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.406838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:18.427444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1022/2056] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:18 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:18.428457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.447571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1035/2057] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:18 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:18.455755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.457418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6f30-486a-4464-a8c6-a22b746b275f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.469846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.472001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.473124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.473744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.475819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.482463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.484318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90ffc9-ed7d-4ddc-b322-b0b9781afebb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.492149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.492902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.493261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.493626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.494438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.496108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.501367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1023/2058] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:18.505301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.517949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1036/2059] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:18.518145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593a11-1c8a-42ca-8bbb-a7f0ff659696 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.518870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.524388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.525041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.525426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.525817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] PATH_INFO: `/v3/projects/afb38c4e7c9d4f09aded4336f0db0b26/users/c34f32ef6c784f46a4374c43a773ca7d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.531330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8760b-cd32-4b91-aad9-388b15271a7a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.536808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.537440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.537788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.538132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.541639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.543525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.553586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb38c4e7c9d4f09aded4336f0db0b26, user_id=c34f32ef6c784f46a4374c43a773ca7d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.557617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.560291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1037/2060] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:18.565822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.575531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:18.581072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1024/2061] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:18 2022] PUT /identity/v3/projects/afb38c4e7c9d4f09aded4336f0db0b26/users/c34f32ef6c784f46a4374c43a773ca7d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:18.581886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df498a3-497b-4b42-8075-eb4cf5f5b355 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.585569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.680612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.681834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.682270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.682653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] PATH_INFO: `/v3/projects/92972f5269c9482b8aadfd2b8d960809/users/71fc18dab1294087a2b5754ef5f702e5/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.718969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=92972f5269c9482b8aadfd2b8d960809, user_id=71fc18dab1294087a2b5754ef5f702e5, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.724097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.768212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1038/2062] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:18 2022] PUT /identity/v3/projects/92972f5269c9482b8aadfd2b8d960809/users/71fc18dab1294087a2b5754ef5f702e5/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:18.768212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:18.768503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208fc25-59ae-49ea-91d3-1dab809d40ee admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.771710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:18.902061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa003b7-2820-4363-8a2c-b1037672e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.902592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa003b7-2820-4363-8a2c-b1037672e134 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.902877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa003b7-2820-4363-8a2c-b1037672e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.903155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa003b7-2820-4363-8a2c-b1037672e134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.904017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa003b7-2820-4363-8a2c-b1037672e134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.907659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa003b7-2820-4363-8a2c-b1037672e134 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.914507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdb84-40ff-4c9a-b06f-3330da4ea0af admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:18.925475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:18.927147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.927984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.928192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] PATH_INFO: `/v3/projects/11b051f209184cfb8e861ecfe0694b0f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:18.930233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b051f209184cfb8e861ecfe0694b0f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:18.932171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:18.937791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1025/2063] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:18.939161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497b525-bc78-4c23-8fa8-c0a17b8ca8f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:18.939456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497b525-bc78-4c23-8fa8-c0a17b8ca8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:18.939737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497b525-bc78-4c23-8fa8-c0a17b8ca8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.002173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4497b525-bc78-4c23-8fa8-c0a17b8ca8f4 None None] MFA Rules not processed for user `71fc18dab1294087a2b5754ef5f702e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:19.004294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4497b525-bc78-4c23-8fa8-c0a17b8ca8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.021951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b051f209184cfb8e861ecfe0694b0f', 'request_id': 'req-a39ad95b-98e5-4481-be15-2956ddbb2c78'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:19.030797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b051f209184cfb8e861ecfe0694b0f', 'request_id': 'req-a39ad95b-98e5-4481-be15-2956ddbb2c78'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:19.039858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b051f209184cfb8e861ecfe0694b0f', 'request_id': 'req-a39ad95b-98e5-4481-be15-2956ddbb2c78'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:19.056971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] The token cache is being invalidate because project 11b051f209184cfb8e861ecfe0694b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:19.057639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:19.058360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:19.061556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1039/2064] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:18 2022] DELETE /identity/v3/projects/11b051f209184cfb8e861ecfe0694b0f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:19.062497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.066784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.089546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:19.095545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:19.117493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1026/2065] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:19.118961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dfdc5-152b-43b1-afeb-a9c50a2113da None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.119254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dfdc5-152b-43b1-afeb-a9c50a2113da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.119533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dfdc5-152b-43b1-afeb-a9c50a2113da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.142478 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eb9dfdc5-152b-43b1-afeb-a9c50a2113da None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:19.144131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eb9dfdc5-152b-43b1-afeb-a9c50a2113da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.174408 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad95b-98e5-4481-be15-2956ddbb2c78 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.181482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a24be-a767-4636-bd13-54156313071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.182453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a24be-a767-4636-bd13-54156313071a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.182744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a24be-a767-4636-bd13-54156313071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.183026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a24be-a767-4636-bd13-54156313071a admin admin] PATH_INFO: `/v3/projects/afb38c4e7c9d4f09aded4336f0db0b26/users/c34f32ef6c784f46a4374c43a773ca7d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.187023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a24be-a767-4636-bd13-54156313071a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb38c4e7c9d4f09aded4336f0db0b26, user_id=c34f32ef6c784f46a4374c43a773ca7d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.194083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a24be-a767-4636-bd13-54156313071a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.206752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1040/2066] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:19 2022] PUT /identity/v3/projects/afb38c4e7c9d4f09aded4336f0db0b26/users/c34f32ef6c784f46a4374c43a773ca7d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:19.207885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a24be-a767-4636-bd13-54156313071a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.218442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-723a24be-a767-4636-bd13-54156313071a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.226169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1027/2067] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:19.227491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.227781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.228054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.273722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] MFA Rules not processed for user `c34f32ef6c784f46a4374c43a773ca7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:19.275350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.325843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a24be-a767-4636-bd13-54156313071a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.331737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853a2ce-38ef-4f87-84d3-1526408353ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.333022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a2ce-38ef-4f87-84d3-1526408353ae admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.333309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a2ce-38ef-4f87-84d3-1526408353ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.333924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a2ce-38ef-4f87-84d3-1526408353ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.334478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853a2ce-38ef-4f87-84d3-1526408353ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.339612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853a2ce-38ef-4f87-84d3-1526408353ae admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.383328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1041/2068] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:19.384469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.385098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.385391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.401067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1028/2069] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:19.402080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.415778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:19.417290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.419131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0588-b06e-463b-b972-c0eef42c8b6d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.555918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.556551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.556837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.557114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.557941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.559809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.564338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1042/2070] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:19.564338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.565735 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.589582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1029/2071] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:19.589582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.600745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb637c-7b02-48bc-8e2c-624f6223fee3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.605997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.606621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.606964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.607248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.608642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:19.608951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.610599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.612595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:19.624334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:19.628335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1030/2072] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:19.629268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.640035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093ab7b-6146-440e-802d-7c7bcfe9d5df admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.650464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e1175-53b2-4ed2-a0c6-0b5f01a42937 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.650646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.651488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.651847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.652221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.653031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.655294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.655423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.655920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.656203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.656935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.659662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:19.669053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1031/2073] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:19.670111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.682676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acc4db-3181-4425-b7c5-e3411a4aaa10 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.688986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.689902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.690380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.690839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.691694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.694472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.736854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1032/2074] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:19.738558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.749444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.751541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.762487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1043/2075] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:19.775045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.803451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc717-1a04-4b77-b54c-5d837aad5356 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.822648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f72a-5bb4-4060-99cf-7b2f56d6f7a2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:19.830046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.830745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.831035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.831318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] PATH_INFO: `/v3/projects/882f131925c24b828b2e54bc5ed47852/users/552d32adce114375bd24ba24d7655183/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.876439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=882f131925c24b828b2e54bc5ed47852, user_id=552d32adce114375bd24ba24d7655183, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.882407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.897271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:19.898126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:19.898485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:19.898918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:19.899843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:19.902374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:19.910291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1033/2076] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:19 2022] PUT /identity/v3/projects/882f131925c24b828b2e54bc5ed47852/users/552d32adce114375bd24ba24d7655183/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:19.914349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.964513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1044/2077] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:19 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:19.967932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:19.994435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b6014-ff46-4a49-be58-6f10ebfba567 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.080780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86199f-3ddc-4bd1-b5a3-ccaab0fde21b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.096185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.096837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.099339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.099646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.100904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.104425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.104846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.106061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.106544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.107023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.107943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.109905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.135058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1045/2079] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:20.138286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1034/2079] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:20.141757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:20.142138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:20.168985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8662-13e7-4325-82bc-e6c06e707528 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.175112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.175998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.176291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.176581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] PATH_INFO: `/v3/projects/882f131925c24b828b2e54bc5ed47852/users/552d32adce114375bd24ba24d7655183/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.181254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=882f131925c24b828b2e54bc5ed47852, user_id=552d32adce114375bd24ba24d7655183, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.184255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.184485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556a2cf-8791-48dd-917b-ea06c86344af admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.193375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc923f76-bc0c-4baf-85df-e60f70a58ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.194295 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923f76-bc0c-4baf-85df-e60f70a58ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.195664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923f76-bc0c-4baf-85df-e60f70a58ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.195664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc923f76-bc0c-4baf-85df-e60f70a58ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.196173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc923f76-bc0c-4baf-85df-e60f70a58ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.198081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc923f76-bc0c-4baf-85df-e60f70a58ae1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.212811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1035/2080] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:20 2022] PUT /identity/v3/projects/882f131925c24b828b2e54bc5ed47852/users/552d32adce114375bd24ba24d7655183/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:20.213989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1046/2081] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:20.217258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:20.226427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.226843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.227189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.255932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:20.286487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] MFA Rules not processed for user `552d32adce114375bd24ba24d7655183`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:20.289084 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:20.289578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:20.383996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee69099-5376-4b29-ac51-9c060f6153eb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.390357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc45ef-cff1-4775-97bd-b8734b5c91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.391534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc45ef-cff1-4775-97bd-b8734b5c91d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.391874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc45ef-cff1-4775-97bd-b8734b5c91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.392152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc45ef-cff1-4775-97bd-b8734b5c91d8 admin admin] PATH_INFO: `/v3/projects/e9f9e88bcc904a109439dcd10c5438dc/users/19681d65ded445c2aed343a5601f8e4f/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.412794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc45ef-cff1-4775-97bd-b8734b5c91d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f9e88bcc904a109439dcd10c5438dc, user_id=19681d65ded445c2aed343a5601f8e4f, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.420459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc45ef-cff1-4775-97bd-b8734b5c91d8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.455013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1036/2082] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:20 2022] PUT /identity/v3/projects/e9f9e88bcc904a109439dcd10c5438dc/users/19681d65ded445c2aed343a5601f8e4f/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:20.457877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.458171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.458453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.484497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1047/2083] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:20.506856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:20.508211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:20.509452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:20.657554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1037/2084] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:20.661530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53409b-ed08-4df7-ad62-db8300f1a5df None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.679931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:20.683865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:20.767050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60560b90-76a0-49bf-92d9-92e642056013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.767781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560b90-76a0-49bf-92d9-92e642056013 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.768135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560b90-76a0-49bf-92d9-92e642056013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.768853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560b90-76a0-49bf-92d9-92e642056013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.824351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c901c7-05d2-40de-b367-c4ffb966d781 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:20.829656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:20.830283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:20.830569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:20.830959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:20.844035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.845704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.857430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1038/2085] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:20.872358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60560b90-76a0-49bf-92d9-92e642056013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:20.874653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60560b90-76a0-49bf-92d9-92e642056013 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:20.879808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:20.895442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1048/2086] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:21.676962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:21.691021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1cd9b-9676-45b5-aa61-6dfbb5e853a5 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:21.697281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:21.698794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:21.699235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:21.699664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] PATH_INFO: `/v3/users/71fc18dab1294087a2b5754ef5f702e5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:21.701862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fc18dab1294087a2b5754ef5f702e5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:21.704050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:21.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:21.781668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:21.782484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:21.793375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fc18dab1294087a2b5754ef5f702e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:21.795971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:21.816133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fc18dab1294087a2b5754ef5f702e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:21.817049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fc18dab1294087a2b5754ef5f702e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:21.817806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fc18dab1294087a2b5754ef5f702e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:21.851948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5dc7706c-e417-425f-a5ab-10339dd0f84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fc18dab1294087a2b5754ef5f702e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:21.862412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] MFA Rules not processed for user `19681d65ded445c2aed343a5601f8e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:21.864458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:21.880689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1039/2087] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:21 2022] DELETE /identity/v3/users/71fc18dab1294087a2b5754ef5f702e5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:21.888064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:21.888511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:21.888945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:21.942678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:21.944046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:22.022620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1049/2088] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:22.047734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:22.050792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:22.078048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59187f11-b714-4a78-970e-9fa181c5b961 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:22.130441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1040/2089] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:22.160330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:22.163034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:22.236369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:22.237015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:22.237321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:22.237628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:22.281354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981cfe5-65fb-435f-8376-e4e3e9c01fc2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:22.287477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:22.289842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:22.290160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:22.290473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:22.305963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:22.307687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:22.311778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:22.313477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:22.320816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1041/2090] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:22.324772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1050/2091] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:22.641997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:22.643446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:22.678538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae805e9c-c66e-409a-bf87-46b9d25db7d2 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:22.687397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:22.688430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:22.688875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:22.689546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] PATH_INFO: `/v3/projects/92972f5269c9482b8aadfd2b8d960809` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:22.691253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92972f5269c9482b8aadfd2b8d960809)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:22.693188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:22.754169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92972f5269c9482b8aadfd2b8d960809', 'request_id': 'req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.760925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92972f5269c9482b8aadfd2b8d960809', 'request_id': 'req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.767161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92972f5269c9482b8aadfd2b8d960809', 'request_id': 'req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.768842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:22.784198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] The token cache is being invalidate because project 92972f5269c9482b8aadfd2b8d960809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:22.784842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.785127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3fecf7c0-30ba-4b27-88b7-733d53a68ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.786907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1042/2092] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:22 2022] DELETE /identity/v3/projects/92972f5269c9482b8aadfd2b8d960809 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:22.791187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:22.802468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866d6bd-68ae-4006-a626-eb51bf8b6c8e service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:22.855476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:22.875364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:22.876195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:22.876547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:22.876888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] PATH_INFO: `/v3/users/552d32adce114375bd24ba24d7655183` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:22.878177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=552d32adce114375bd24ba24d7655183)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:22.880209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:22.934495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552d32adce114375bd24ba24d7655183'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.950345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552d32adce114375bd24ba24d7655183'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.951175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552d32adce114375bd24ba24d7655183'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.952370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552d32adce114375bd24ba24d7655183'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.967888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552d32adce114375bd24ba24d7655183'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:22.983054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1051/2093] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:22 2022] DELETE /identity/v3/users/552d32adce114375bd24ba24d7655183 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:23.767913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2058-1c3f-4499-890f-5d4186b95de9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:23.768446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2058-1c3f-4499-890f-5d4186b95de9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:23.768581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2058-1c3f-4499-890f-5d4186b95de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:23.788206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ebbf2058-1c3f-4499-890f-5d4186b95de9 None None] MFA Rules not processed for user `19681d65ded445c2aed343a5601f8e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:23.789457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ebbf2058-1c3f-4499-890f-5d4186b95de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:23.848931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1043/2094] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:23.990588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:23.993378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:24.101700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fbd04-0ac4-492a-9d31-f1c488308c88 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.107196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.110076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.110306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.110587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] PATH_INFO: `/v3/projects/882f131925c24b828b2e54bc5ed47852` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.111845 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882f131925c24b828b2e54bc5ed47852)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.113819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.175302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882f131925c24b828b2e54bc5ed47852', 'request_id': 'req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:24.182860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882f131925c24b828b2e54bc5ed47852', 'request_id': 'req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:24.195725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882f131925c24b828b2e54bc5ed47852', 'request_id': 'req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:24.198484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:24.214250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] The token cache is being invalidate because project 882f131925c24b828b2e54bc5ed47852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:24.214557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:24.215169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-ff59e9da-c04a-4efc-b8a5-3b2535c09d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:24.217479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1052/2095] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:23 2022] DELETE /identity/v3/projects/882f131925c24b828b2e54bc5ed47852 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:24.222114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.222490 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.222835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.243838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:24.245195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:24.345928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1044/2096] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:24.348654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.350782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.351109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.384082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:24.385771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:24.395728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1053/2097] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:24.399967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.413831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442761f-ec71-4bf5-ae33-50e50fbf0247 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.419061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.420091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.420538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.421460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.422366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:24.423271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.424417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.445974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1045/2098] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:24.446708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.459779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d63921-c3e3-4353-b725-583db4912d59 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.471168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.471806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.472091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.472367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.473035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.476036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.517210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1054/2099] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:24 2022] POST /identity/v3/projects => generated 397 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:24.521115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.537843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462607-1901-4e6d-b498-bdf0c2843392 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.623755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.624702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.625087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.625529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.626617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.629189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.660255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1046/2100] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:24 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:24.661273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.671839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf8c8-6f6f-41d5-b495-373641aa57e7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.676459 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.677327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.677629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.677918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.678667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.680262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.693776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1055/2101] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:24.698768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.725903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285add9-9d3f-4380-b6ba-579347d8e6bf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.740094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90e1a-d155-4b35-b4d9-084df979a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.740749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90e1a-d155-4b35-b4d9-084df979a2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.742476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90e1a-d155-4b35-b4d9-084df979a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.742476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90e1a-d155-4b35-b4d9-084df979a2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.744298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90e1a-d155-4b35-b4d9-084df979a2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.747424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90e1a-d155-4b35-b4d9-084df979a2c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.777611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1047/2102] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:24.782125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.805071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb9da-e70e-4c78-a0e5-aa47954dec90 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:24.813188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:24.814051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.814438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.815512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] PATH_INFO: `/v3/projects/8855a8bf31574b4bacaffd83dfb26491/users/54e2cdf4d8c245e2bd42ce75d0e85c04/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.833451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8855a8bf31574b4bacaffd83dfb26491, user_id=54e2cdf4d8c245e2bd42ce75d0e85c04, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:24.836453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:24.852833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1056/2103] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:24 2022] PUT /identity/v3/projects/8855a8bf31574b4bacaffd83dfb26491/users/54e2cdf4d8c245e2bd42ce75d0e85c04/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:24.865221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:24.865859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:24.866246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:24.875267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:24.923936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:24.925881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:24.943015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] MFA Rules not processed for user `54e2cdf4d8c245e2bd42ce75d0e85c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:24.945420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:25.008415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584ca6c-bd96-4c7a-af71-51c9cc06274e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:25.012401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:25.023622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:25.023963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:25.024480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:25.028230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:25.028351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1048/2104] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:25.044021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:25.046660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:25.066284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612acc2-0dc2-4507-aaf0-9bd8489a9f78 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:25.074319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:25.075156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:25.075572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:25.077500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:25.094013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:25.096204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:25.122236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1049/2105] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:25.124163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:25.125979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:25.142074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1057/2106] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:31.445892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:31.447497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:31.546657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bec412-bc7b-471c-8ac0-7985dcf2cec1 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:31.551689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:31.552719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:31.553005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:31.553286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] PATH_INFO: `/v3/users/f3e166fa55484ea49e09863d7f865c05` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:31.554844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e166fa55484ea49e09863d7f865c05)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:31.556891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:31.654573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:31.668572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623e5c-6ba2-424a-bc66-86144c1ea9cd service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:31.669081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e166fa55484ea49e09863d7f865c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.674771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:31.675530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:31.675888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:31.676237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] PATH_INFO: `/v3/users/54e2cdf4d8c245e2bd42ce75d0e85c04` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:31.678181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e2cdf4d8c245e2bd42ce75d0e85c04)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:31.682951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:31.683174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e166fa55484ea49e09863d7f865c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.684096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e166fa55484ea49e09863d7f865c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.684720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e166fa55484ea49e09863d7f865c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.728315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d90bc442-4b92-4e24-a9a4-a4522ec12fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e166fa55484ea49e09863d7f865c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.752202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=3,keystone:DELETE=6,keystone:SELECT=91 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:31.755953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:31.772062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1050/2107] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:31 2022] DELETE /identity/v3/users/f3e166fa55484ea49e09863d7f865c05 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:31.774127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:31.774422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:31.774700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:31.790679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e2cdf4d8c245e2bd42ce75d0e85c04'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.796067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:31.797670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:31.809471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e2cdf4d8c245e2bd42ce75d0e85c04'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.818836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e2cdf4d8c245e2bd42ce75d0e85c04'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.819956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e2cdf4d8c245e2bd42ce75d0e85c04'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.846319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e387b831-b846-4dcd-b03c-ada926bc6b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e2cdf4d8c245e2bd42ce75d0e85c04'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:31.876356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1058/2108] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:31 2022] DELETE /identity/v3/users/54e2cdf4d8c245e2bd42ce75d0e85c04 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:31.882172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:31.882732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:31.882732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:31.891446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1051/2109] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:31.903112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:31.904751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:31.915217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:31.916674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:31.995807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1059/2110] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:32.000752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f5bf1-0305-458e-9b19-15ebad5d2719 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:32.008301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:32.066336 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:32.068063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.068352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.068833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.077732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496dbf-42d9-4ba1-bbeb-a46576c75410 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:32.081612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:32.082531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:32.083157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.083284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:32.083435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.083866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.097409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:32.100093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:32.113738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1052/2111] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:32.114951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1060/2112] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:32.661869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:32.663431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:32.671190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:32.673255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:32.678158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d553f-38f7-4f72-9e16-b286cfd8b3da service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:32.694903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119216c-465c-44a3-bc98-3203857f9131 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:32.700482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:32.701704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.701990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.702264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] PATH_INFO: `/v3/projects/8855a8bf31574b4bacaffd83dfb26491` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.703543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8855a8bf31574b4bacaffd83dfb26491)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:32.705544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:32.709854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:32.710532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.710841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.711105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] PATH_INFO: `/v3/projects/0ae7a14b253244afb57347d1744edd58` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.712329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae7a14b253244afb57347d1744edd58)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:32.714318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:32.766840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:32.768205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8855a8bf31574b4bacaffd83dfb26491', 'request_id': 'req-3d3a493a-c02b-4015-96f1-dd64954a5775'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.773355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae7a14b253244afb57347d1744edd58', 'request_id': 'req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.775357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:32.777153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8855a8bf31574b4bacaffd83dfb26491', 'request_id': 'req-3d3a493a-c02b-4015-96f1-dd64954a5775'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.781082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae7a14b253244afb57347d1744edd58', 'request_id': 'req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.784360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8855a8bf31574b4bacaffd83dfb26491', 'request_id': 'req-3d3a493a-c02b-4015-96f1-dd64954a5775'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.788847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae7a14b253244afb57347d1744edd58', 'request_id': 'req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.799133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] The token cache is being invalidate because project 8855a8bf31574b4bacaffd83dfb26491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:32.799434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.800170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-3d3a493a-c02b-4015-96f1-dd64954a5775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.802194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1061/2113] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:32 2022] DELETE /identity/v3/projects/8855a8bf31574b4bacaffd83dfb26491 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:32.803966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] The token cache is being invalidate because project 0ae7a14b253244afb57347d1744edd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:32.804262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.804907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.806508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1053/2114] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:32 2022] DELETE /identity/v3/projects/0ae7a14b253244afb57347d1744edd58 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:32.807410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e188b5-ca26-4df3-8280-f9f4d9b7d741 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.807718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e188b5-ca26-4df3-8280-f9f4d9b7d741 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.808002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e188b5-ca26-4df3-8280-f9f4d9b7d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.810127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:32.811510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:32.831625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a2e188b5-ca26-4df3-8280-f9f4d9b7d741 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:32.833270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a2e188b5-ca26-4df3-8280-f9f4d9b7d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:32.894731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31cbb8-7e0d-46ea-85a6-10c6b7306a9e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:32.899818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:32.900561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.900914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.901321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] PATH_INFO: `/v3/users/c34f32ef6c784f46a4374c43a773ca7d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.903019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34f32ef6c784f46a4374c43a773ca7d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:32.905639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:32.912707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1062/2115] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:32.920999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.921290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.921569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.954171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:32.955504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:32.964837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1063/2116] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:32.969485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:32.975492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34f32ef6c784f46a4374c43a773ca7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.978836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af355d0b-d4e1-4d14-9e5e-5885047b6734 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:32.982938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34f32ef6c784f46a4374c43a773ca7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.983768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34f32ef6c784f46a4374c43a773ca7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.983877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:32.984270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34f32ef6c784f46a4374c43a773ca7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:32.984377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:32.984717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:32.984902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:32.985578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:32.985914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:32.987631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:32.998789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34f32ef6c784f46a4374c43a773ca7d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:33.003829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1064/2117] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:44:33.008466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.010603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:33.016535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1054/2118] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:32 2022] DELETE /identity/v3/users/c34f32ef6c784f46a4374c43a773ca7d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:33.025743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b391a-a6ef-4af6-b2b8-7542b80bb7aa admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.094071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.094704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.094993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.095279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.096102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.098214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.137855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1065/2119] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:33.140508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.153097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835c665-3086-424a-a1b6-440a553f01f1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.234961 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.235586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.235871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.236152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.236884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.239240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.251533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:33.271793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1055/2120] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:33.276022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.288286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db782a-9ebd-429b-9ec0-c5009e4d8d4e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.293141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.294039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.294168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.294351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.295089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.296707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.313585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1066/2121] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:33.315281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.327947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1e776-264b-4e35-a3e7-121cda328d79 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.333655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.334365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.334728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.335082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.335867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.337849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.338602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.345534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:33.353671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1056/2122] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:33.355014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.365205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880312-68d6-4c1b-9413-fb06b969714c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.367266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799fe90-98e4-4616-b434-17539c2eb274 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.370479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.371288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.371582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.371862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] PATH_INFO: `/v3/projects/afb38c4e7c9d4f09aded4336f0db0b26` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.373953 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb38c4e7c9d4f09aded4336f0db0b26)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.376727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.383306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5bb3-3145-49d1-b45a-ae01bf37f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.386509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5bb3-3145-49d1-b45a-ae01bf37f557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.386836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5bb3-3145-49d1-b45a-ae01bf37f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.387128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5bb3-3145-49d1-b45a-ae01bf37f557 admin admin] PATH_INFO: `/v3/projects/efd99b7114b44484a297c84fefb7e19f/users/abd1937e53d34b53b1415ae97f9a04bb/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.403703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c5bb3-3145-49d1-b45a-ae01bf37f557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd99b7114b44484a297c84fefb7e19f, user_id=abd1937e53d34b53b1415ae97f9a04bb, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.407430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c5bb3-3145-49d1-b45a-ae01bf37f557 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.415164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:33.425375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1057/2123] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:33 2022] PUT /identity/v3/projects/efd99b7114b44484a297c84fefb7e19f/users/abd1937e53d34b53b1415ae97f9a04bb/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:33.430271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.430752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.431069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.437637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb38c4e7c9d4f09aded4336f0db0b26', 'request_id': 'req-651d53da-436d-4ffb-86c4-78359be4f045'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:33.446830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb38c4e7c9d4f09aded4336f0db0b26', 'request_id': 'req-651d53da-436d-4ffb-86c4-78359be4f045'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:33.450636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:33.452315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:33.456084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb38c4e7c9d4f09aded4336f0db0b26', 'request_id': 'req-651d53da-436d-4ffb-86c4-78359be4f045'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:33.473562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] The token cache is being invalidate because project afb38c4e7c9d4f09aded4336f0db0b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:33.474338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:33.475420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-651d53da-436d-4ffb-86c4-78359be4f045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:33.477043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1067/2124] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:33 2022] DELETE /identity/v3/projects/afb38c4e7c9d4f09aded4336f0db0b26 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:33.483166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a4a72-ec67-43ae-a13c-631c98e9fce5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.483654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a4a72-ec67-43ae-a13c-631c98e9fce5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.484205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a4a72-ec67-43ae-a13c-631c98e9fce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.504453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-474a4a72-ec67-43ae-a13c-631c98e9fce5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:33.505805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-474a4a72-ec67-43ae-a13c-631c98e9fce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:33.517782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1058/2125] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:33.527462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.528821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:33.581804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1068/2126] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:33.591452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.592403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.592733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.609922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9527dc-82ab-48ef-b139-1a8588b01ba7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.614848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:33.616077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:33.616449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.617236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.617521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.617856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.624977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1069/2127] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:33.629073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.630619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.634439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.640254 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eaec8-b4d8-4520-8580-2bc80ff27efd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.649688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1059/2128] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:33.650441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.651065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.651347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.651624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.652329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:33.652631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.654478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.667984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1070/2129] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:33.672406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.687169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d13507-470e-40e8-9ebd-e47f2a16351e service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.693484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.693484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.693484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.693484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.694532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.694532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.735013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1060/2130] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:33.736997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.748651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735a39-0574-4ea9-8e5b-1eed34b85e60 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.830377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.831127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.831473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.831907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.832633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.835520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.864503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1071/2131] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:33 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:33.868415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.881454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb2d8-7893-4edf-8f18-f061619225af admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.887145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.887861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.888226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.888435 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.889817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.891687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.908062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1061/2132] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:33.909131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.921983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b742f-c97d-4760-955d-8e84145a0590 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.933931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ca347-fa5a-4a6f-bb89-74f8102ea38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.934708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ca347-fa5a-4a6f-bb89-74f8102ea38b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.934999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ca347-fa5a-4a6f-bb89-74f8102ea38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.935282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ca347-fa5a-4a6f-bb89-74f8102ea38b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.936624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ca347-fa5a-4a6f-bb89-74f8102ea38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:33.938836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ca347-fa5a-4a6f-bb89-74f8102ea38b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:33.957390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1072/2133] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:33.961236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:33.972544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b2d1-34a5-4ebf-aa8e-ae90c546e67f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:33.978370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:33.979696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:33.979696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:33.979696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] PATH_INFO: `/v3/projects/5233d6c564cc45a4acc267f9366b968f/users/9d6bc67637864bc6ab0ae51108676731/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:33.998983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5233d6c564cc45a4acc267f9366b968f, user_id=9d6bc67637864bc6ab0ae51108676731, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:34.002086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:34.013344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:34.027894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1062/2134] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:33 2022] PUT /identity/v3/projects/5233d6c564cc45a4acc267f9366b968f/users/9d6bc67637864bc6ab0ae51108676731/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:34.039418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:34.039734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:34.040037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:34.087391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:34.091692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] MFA Rules not processed for user `9d6bc67637864bc6ab0ae51108676731`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:34.095440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:34.205378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1073/2135] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:34.218926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:34.220910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:34.296466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a26805-6528-4bbf-9cb8-e0e5e445ef3c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:34.301369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20ec1b-dff1-4a1f-bda4-95503ad6f765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:34.302802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ec1b-dff1-4a1f-bda4-95503ad6f765 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:34.303159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ec1b-dff1-4a1f-bda4-95503ad6f765 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:34.303643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ec1b-dff1-4a1f-bda4-95503ad6f765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:34.316062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20ec1b-dff1-4a1f-bda4-95503ad6f765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:34.317714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20ec1b-dff1-4a1f-bda4-95503ad6f765 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:34.328033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1063/2136] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:34.361365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:34.440155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0af569-9533-48e7-a42d-e4061e6e0e61 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:34.445257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:34.445949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:34.446235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:34.446517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] PATH_INFO: `/v3/users/9d6bc67637864bc6ab0ae51108676731` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:34.447722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6bc67637864bc6ab0ae51108676731)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:34.450973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:34.519231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6bc67637864bc6ab0ae51108676731'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:34.530787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6bc67637864bc6ab0ae51108676731'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:34.531929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6bc67637864bc6ab0ae51108676731'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:34.532870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6bc67637864bc6ab0ae51108676731'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:34.549792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6bc67637864bc6ab0ae51108676731'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:34.575368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1074/2137] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:34 2022] DELETE /identity/v3/users/9d6bc67637864bc6ab0ae51108676731 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:34.580219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:34.580585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:34.580956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:34.614771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:34.616018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:34.699607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1064/2138] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:34.722159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:34.724886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:34.778456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:34.844339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962df9f-c9e1-4586-b1e8-97ef398a83be admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:34.852968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06541-2840-42b9-baad-19a78b0a747c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:34.853803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06541-2840-42b9-baad-19a78b0a747c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:34.854088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06541-2840-42b9-baad-19a78b0a747c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:34.854501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06541-2840-42b9-baad-19a78b0a747c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:34.866203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06541-2840-42b9-baad-19a78b0a747c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:34.868385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06541-2840-42b9-baad-19a78b0a747c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:34.882210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1075/2139] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:35.923016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:35.924629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:35.942131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6042a3-b922-4e0b-a17d-4a942563f7bf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:35.947966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:35.948880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:35.949296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:35.949781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] PATH_INFO: `/v3/projects/5233d6c564cc45a4acc267f9366b968f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:35.951853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5233d6c564cc45a4acc267f9366b968f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:35.954036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.010551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5233d6c564cc45a4acc267f9366b968f', 'request_id': 'req-41c0b611-a3de-4ac3-a040-dd626a48608c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:36.018629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5233d6c564cc45a4acc267f9366b968f', 'request_id': 'req-41c0b611-a3de-4ac3-a040-dd626a48608c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:36.025714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5233d6c564cc45a4acc267f9366b968f', 'request_id': 'req-41c0b611-a3de-4ac3-a040-dd626a48608c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:36.043839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] The token cache is being invalidate because project 5233d6c564cc45a4acc267f9366b968f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:36.044282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:36.045216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-41c0b611-a3de-4ac3-a040-dd626a48608c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:36.047246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1065/2140] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:35 2022] DELETE /identity/v3/projects/5233d6c564cc45a4acc267f9366b968f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:36.052423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.052873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.052990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.075607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:36.077631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:36.156443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1076/2141] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:36.164649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.164951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.165237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.192891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:36.194176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:36.204009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1066/2142] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:36.207997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:36.218519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cead1a-ea93-4475-87f6-8e9fe340d025 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:36.223781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:36.225463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.225909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.226628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.227474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:36.229340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:36.231282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.246284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1077/2143] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:36.251583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:36.261980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976155cb-770f-4c03-b0dd-b6cd5a239691 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:36.269927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:36.270567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.270861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.271137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.272043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:36.274218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.311079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:36.333352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:36.336590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1067/2144] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:36 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:36.347016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bb92-28c8-4de9-ac5b-dab66b4f93dc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:36.465425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:36.466492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.467042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.467540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.468577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:36.470772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.517048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:36.533031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1078/2145] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:36 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:36.537045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86115a-7e1b-4e5e-a77d-3577d75e2785 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:36.542318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:36.543116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.543831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.544297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.546456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:36.548503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.565969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1068/2146] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:36.566804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:36.578641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f6d0e-8446-4443-acc0-6bd14979c73e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:36.586369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d3885-f650-4abc-b807-5c9c4f00f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:36.587557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3885-f650-4abc-b807-5c9c4f00f2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.588095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3885-f650-4abc-b807-5c9c4f00f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.588442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d3885-f650-4abc-b807-5c9c4f00f2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.589217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d3885-f650-4abc-b807-5c9c4f00f2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:36.592237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d3885-f650-4abc-b807-5c9c4f00f2bf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.611332 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:36.618319 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1079/2147] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:36.624479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9bee-49cf-4774-9216-bc2e62c8bc36 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:36.632390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:36.633284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.633619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.641173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] PATH_INFO: `/v3/projects/43014d6dad2d4cc6b88a50f64fabdfe4/users/5ddb07f3a93849ec92dccc564eaab30f/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.683345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43014d6dad2d4cc6b88a50f64fabdfe4, user_id=5ddb07f3a93849ec92dccc564eaab30f, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:36.696233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:36.723563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1069/2148] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:36 2022] PUT /identity/v3/projects/43014d6dad2d4cc6b88a50f64fabdfe4/users/5ddb07f3a93849ec92dccc564eaab30f/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:36.734999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8319cb-ee8b-4f3e-9a10-b9c2f59bb2ac None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:36.735279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8319cb-ee8b-4f3e-9a10-b9c2f59bb2ac None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:36.735560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8319cb-ee8b-4f3e-9a10-b9c2f59bb2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:36.848831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9e8319cb-ee8b-4f3e-9a10-b9c2f59bb2ac None None] MFA Rules not processed for user `5ddb07f3a93849ec92dccc564eaab30f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:36.850121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9e8319cb-ee8b-4f3e-9a10-b9c2f59bb2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:36.947530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:37.061205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1080/2149] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:37.071426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:37.074078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:37.245624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14751f6-1101-4b47-957e-c432e348f144 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:37.256914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c5fe7-941b-4130-8283-8c7e317dc947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:37.258245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c5fe7-941b-4130-8283-8c7e317dc947 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:37.258685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c5fe7-941b-4130-8283-8c7e317dc947 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:37.259106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c5fe7-941b-4130-8283-8c7e317dc947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:37.278917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c5fe7-941b-4130-8283-8c7e317dc947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:37.283952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c5fe7-941b-4130-8283-8c7e317dc947 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:37.296250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1070/2150] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:40.005773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126dcf5-e4d1-47c8-a88e-63d7788762f0 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.006624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126dcf5-e4d1-47c8-a88e-63d7788762f0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.007054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126dcf5-e4d1-47c8-a88e-63d7788762f0 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.008963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1081/2151] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:44:40.052884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.054217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.054646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.061079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126dcf5-e4d1-47c8-a88e-63d7788762f0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.075282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126dcf5-e4d1-47c8-a88e-63d7788762f0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.080500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.081363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.082680 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.083143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.085841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.103066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:40.108281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.212631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.214537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:40.241810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1071/2152] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:40.244269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.246583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.257819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1082/2153] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:40.260090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.265819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.295553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a54048-da32-460a-8142-4c5ea630b74e service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.303346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb63572-eb89-4eb1-87b8-96473e72b148 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.304737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63572-eb89-4eb1-87b8-96473e72b148 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.305274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63572-eb89-4eb1-87b8-96473e72b148 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.305553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63572-eb89-4eb1-87b8-96473e72b148 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.316536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63572-eb89-4eb1-87b8-96473e72b148 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.318517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63572-eb89-4eb1-87b8-96473e72b148 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:40.335996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1083/2154] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:40.337248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.337540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.337844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.361921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8910-0847-4107-abf8-88675e2ee41e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.377525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.385763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.386343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.387489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] PATH_INFO: `/v3/users/7137e696c39443a7a1e5c6b92d74cec5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.388958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7137e696c39443a7a1e5c6b92d74cec5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.391631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:40.392305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] MFA Rules not processed for user `abd1937e53d34b53b1415ae97f9a04bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:40.394107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.395514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:40.481718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7137e696c39443a7a1e5c6b92d74cec5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:40.492379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7137e696c39443a7a1e5c6b92d74cec5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:40.493371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7137e696c39443a7a1e5c6b92d74cec5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:40.494262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7137e696c39443a7a1e5c6b92d74cec5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:40.508032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1084/2155] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:40.512839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7137e696c39443a7a1e5c6b92d74cec5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:40.513581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.515208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.533010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1072/2156] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:40 2022] DELETE /identity/v3/users/7137e696c39443a7a1e5c6b92d74cec5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:40.541190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5a6d6-375a-4e38-b887-8dc16f608c65 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.603702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:40.640962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.641919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.642201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.642477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.643192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.645063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:40.682949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1085/2157] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:40 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:40.684090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.685581 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.713579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff20e2-0a4c-49d1-8e86-db5a2f2c5929 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.789371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.799570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:40.854791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.855868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.856730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.856730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.857475 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.862903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:40.895281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1073/2158] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:40 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:40.900406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:40.928661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fcdc3-a8c3-4f4b-a5cb-0b6b3ef8f605 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.942553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.943635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.944123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.944577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.945455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.949329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:40.984731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e321c-bbbc-4d47-954a-29d010239050 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:40.990139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:40.990936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:40.991360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:40.991645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] PATH_INFO: `/v3/projects/8115f56128fd44f3beebe79b49d403c0` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:40.995783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1074/2159] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:40.995902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8115f56128fd44f3beebe79b49d403c0)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:40.997943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.005944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.032937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788bb34-c36d-48ef-a26d-f17f70a06aac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.043903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.044643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.044930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.045210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] PATH_INFO: `/v3/projects/2b2a5df40ef24392ab4bedfb5ae6cf54/users/41212e62ee6a4ccdacb1431525b53e48/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.077053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2a5df40ef24392ab4bedfb5ae6cf54, user_id=41212e62ee6a4ccdacb1431525b53e48, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.080975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.119588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1075/2160] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:40 2022] PUT /identity/v3/projects/2b2a5df40ef24392ab4bedfb5ae6cf54/users/41212e62ee6a4ccdacb1431525b53e48/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:41.123712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.128005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8115f56128fd44f3beebe79b49d403c0', 'request_id': 'req-d1908fa1-b747-40bf-8995-09c2c0f01cc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:41.140311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8115f56128fd44f3beebe79b49d403c0', 'request_id': 'req-d1908fa1-b747-40bf-8995-09c2c0f01cc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:41.147678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8115f56128fd44f3beebe79b49d403c0', 'request_id': 'req-d1908fa1-b747-40bf-8995-09c2c0f01cc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:41.179134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] The token cache is being invalidate because project 8115f56128fd44f3beebe79b49d403c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:41.179134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:41.180053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d1908fa1-b747-40bf-8995-09c2c0f01cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:41.182120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1086/2161] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:40 2022] DELETE /identity/v3/projects/8115f56128fd44f3beebe79b49d403c0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:41.190439 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3801f-fd9a-4f2f-b89b-cb64eee541f9 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.190852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3801f-fd9a-4f2f-b89b-cb64eee541f9 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.191202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3801f-fd9a-4f2f-b89b-cb64eee541f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.228582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:41.242862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-dde3801f-fd9a-4f2f-b89b-cb64eee541f9 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:41.244350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-dde3801f-fd9a-4f2f-b89b-cb64eee541f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:41.296526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ea149-c5f3-4516-8b90-b8635eadd85b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.315962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.316819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.317135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.317893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.319668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.325351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.345420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:41.374069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1076/2162] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:41.377669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.378970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1087/2163] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:41.386987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.387620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.387805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:41.388882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.405225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05096b2-5586-4ca9-82c2-bab4ce1222c5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.412229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.413365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.413686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.414007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] PATH_INFO: `/v3/projects/2b2a5df40ef24392ab4bedfb5ae6cf54/users/41212e62ee6a4ccdacb1431525b53e48/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.417195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2a5df40ef24392ab4bedfb5ae6cf54, user_id=41212e62ee6a4ccdacb1431525b53e48, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.421864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.442356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1077/2164] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:41 2022] PUT /identity/v3/projects/2b2a5df40ef24392ab4bedfb5ae6cf54/users/41212e62ee6a4ccdacb1431525b53e48/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:41.444564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:41.446273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:41.525962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1088/2165] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:41.528609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.546653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713a4a8-283f-4ad9-b4f5-a88b00098334 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.563072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.563072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.563072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.563072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.563468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:41.564768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.573883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.613103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.613442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1078/2166] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:41.632442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c411b-1d2a-4f75-a851-1354adbf27e5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.651969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.653540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.654195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.654431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.655274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.657886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.723712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1089/2167] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:41 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:41.728630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.742795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613518-25bd-4959-87b1-4849ddcf539c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.850215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.851012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.851330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.851564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.852522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.855545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.891514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1079/2168] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:41 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:41.896384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.909289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d0290-d5ee-421d-8839-4e269d29ef8a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.924903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.925760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.926027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.928454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.929218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.932803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:41.955361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1090/2169] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:41.956387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:41.976640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa41c-ed6d-40c8-9a04-1069f8f9e684 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:41.984821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56404b9a-475a-478c-b50f-564f26b96faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:41.985902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56404b9a-475a-478c-b50f-564f26b96faf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:41.986191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56404b9a-475a-478c-b50f-564f26b96faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:41.986469 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56404b9a-475a-478c-b50f-564f26b96faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:41.987240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56404b9a-475a-478c-b50f-564f26b96faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:41.989000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56404b9a-475a-478c-b50f-564f26b96faf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:42.003282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1080/2170] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:42.007664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:42.024216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0d20e-d873-4a5b-bf5a-951d205803b0 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:42.039974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:42.040850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:42.041212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:42.041751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] PATH_INFO: `/v3/projects/fde52f137f534c7bafb95217432b06b2/users/3392e20327624b8db40b7f5140c33fe9/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:42.070296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde52f137f534c7bafb95217432b06b2, user_id=3392e20327624b8db40b7f5140c33fe9, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:42.074752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:42.093664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1091/2171] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:42 2022] PUT /identity/v3/projects/fde52f137f534c7bafb95217432b06b2/users/3392e20327624b8db40b7f5140c33fe9/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:42.102532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:42.103061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:42.103227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:42.146320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] MFA Rules not processed for user `3392e20327624b8db40b7f5140c33fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:42.147496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:42.224454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1081/2172] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:42.236102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:42.237947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:42.320906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ca1dd-90ae-47a8-8e10-34b22f1b2dbb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:42.327376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ffba-f9e3-44cd-bdb3-c847074a3072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:42.328024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ffba-f9e3-44cd-bdb3-c847074a3072 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:42.328317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ffba-f9e3-44cd-bdb3-c847074a3072 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:42.328597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ffba-f9e3-44cd-bdb3-c847074a3072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:42.338560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40ffba-f9e3-44cd-bdb3-c847074a3072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:42.340148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40ffba-f9e3-44cd-bdb3-c847074a3072 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:42.352077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1092/2173] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:42.693141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:42.714446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:42.845792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607909ad-8073-4fb3-bd6a-e7c7b6885651 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:42.851741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:42.852878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:42.853264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:42.853677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] PATH_INFO: `/v3/users/3392e20327624b8db40b7f5140c33fe9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:42.855161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3392e20327624b8db40b7f5140c33fe9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:42.857390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:42.985016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3392e20327624b8db40b7f5140c33fe9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:42.994465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3392e20327624b8db40b7f5140c33fe9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:42.995553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3392e20327624b8db40b7f5140c33fe9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:42.996282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3392e20327624b8db40b7f5140c33fe9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:43.019331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3392e20327624b8db40b7f5140c33fe9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:43.043207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1082/2174] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:42 2022] DELETE /identity/v3/users/3392e20327624b8db40b7f5140c33fe9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:43.048010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:43.048955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:43.049289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:43.088356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:43.092028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:43.112229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:43.240291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1093/2175] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:43.357106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:43.359270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:43.472134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a731036-e5b0-4c5e-bcc8-7c263a067ce9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:43.476877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b80b9f-19e2-4d14-aa88-d5d01301452d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:43.477501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80b9f-19e2-4d14-aa88-d5d01301452d service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:43.477890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80b9f-19e2-4d14-aa88-d5d01301452d service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:43.478177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80b9f-19e2-4d14-aa88-d5d01301452d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:43.491249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b80b9f-19e2-4d14-aa88-d5d01301452d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:43.492989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b80b9f-19e2-4d14-aa88-d5d01301452d service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:43.507144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1083/2176] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:44.138009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:44.139704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:44.159251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0595-eb79-4472-b0ca-741c2b2f2598 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:44.175108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:44.176042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:44.176477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:44.177725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] PATH_INFO: `/v3/projects/fde52f137f534c7bafb95217432b06b2` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:44.179236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde52f137f534c7bafb95217432b06b2)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:44.184402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:44.286202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde52f137f534c7bafb95217432b06b2', 'request_id': 'req-91d30ad9-c95d-42dd-8bc4-c8a836596d06'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:44.295426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde52f137f534c7bafb95217432b06b2', 'request_id': 'req-91d30ad9-c95d-42dd-8bc4-c8a836596d06'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:44.310650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde52f137f534c7bafb95217432b06b2', 'request_id': 'req-91d30ad9-c95d-42dd-8bc4-c8a836596d06'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:44.331813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] The token cache is being invalidate because project fde52f137f534c7bafb95217432b06b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:44.332780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:44.333934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-91d30ad9-c95d-42dd-8bc4-c8a836596d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:44.341067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:44.341067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:44.342076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:44.342484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1094/2177] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:44 2022] DELETE /identity/v3/projects/fde52f137f534c7bafb95217432b06b2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:44.388928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:44.396638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:44.500397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:44.550759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:44.551047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:44.551324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:44.572623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1084/2178] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:44.624289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:44.624289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:44.649428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1095/2179] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:44.650705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:44.670517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a2b14-6db6-40f3-970b-36a56705c930 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:44.691414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:44.691968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:44.692261 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:44.692541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:44.694559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:44.694873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:44.703098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:44.732931 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1085/2180] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:44.734524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:44.746035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c401-4f78-4aa9-ac65-4f83e3bc5230 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:44.762679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:44.763989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:44.764416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:44.764753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:44.765671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:44.767681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:44.867446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1096/2181] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:44 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:44.871584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:44.896190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b33ca-ba63-4014-a255-891f169beb80 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:45.027749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:45.028397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:45.028686 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:45.029012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:45.029739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:45.031827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:45.063099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1086/2182] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:44 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:45.070976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:45.085834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ecf48-372d-42ba-a56b-435713da939f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:45.097816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:45.098974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:45.099879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:45.100265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:45.101553 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:45.105472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:45.128783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1097/2183] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:45.133158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:45.170258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c8c3-266e-4c05-8fd1-a76e1fdafac6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:45.189349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a8543-31cb-4d85-9109-81d4db4266cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:45.190030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a8543-31cb-4d85-9109-81d4db4266cc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:45.190318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a8543-31cb-4d85-9109-81d4db4266cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:45.190896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a8543-31cb-4d85-9109-81d4db4266cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:45.191310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a8543-31cb-4d85-9109-81d4db4266cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:45.193688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a8543-31cb-4d85-9109-81d4db4266cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:45.210124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1087/2184] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:45.214714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:45.230080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa1be7-6d16-4d24-8732-e61017485a48 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:45.242655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:45.243614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:45.244108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:45.244591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] PATH_INFO: `/v3/projects/5b43d7a2e20844eea7c6456f556d7bd8/users/a7f9736838164fc3986d1073edcedbcb/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:45.272234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b43d7a2e20844eea7c6456f556d7bd8, user_id=a7f9736838164fc3986d1073edcedbcb, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:45.286872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:45.347468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1098/2185] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:45 2022] PUT /identity/v3/projects/5b43d7a2e20844eea7c6456f556d7bd8/users/a7f9736838164fc3986d1073edcedbcb/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:45.359265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:45.359862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:45.360151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:45.465546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] MFA Rules not processed for user `a7f9736838164fc3986d1073edcedbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:45.471231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:45.637506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1088/2186] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:45.638456 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:45.763306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:45.817833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c77b5-7e1d-4762-882b-48af55cfc350 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:45.828410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:45.829138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:45.831834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:45.832209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:45.832978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:45.839219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:45.905533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1099/2187] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:45 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:45.909483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:45.930923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29562838-fbe2-435e-950a-9e1b233e61c5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:45.996020 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:46.073586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:46.074064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:46.074355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:46.074998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:46.075665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:46.077655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:46.130800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1089/2188] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:45 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:46.134992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:46.175918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784477e-9df1-4155-b832-52e41949575e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:46.206870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:46.207535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:46.207813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:46.208104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:46.208819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:46.210515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:46.235788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1100/2189] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:46.241914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:46.256797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e211cbd-a440-41a7-bed2-3338f0fde0db admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:46.277383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:46.278156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:46.278588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:46.278926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] PATH_INFO: `/v3/projects/a29a4edd412940fab6cdd1c1d6f2b637/users/04ba2464e57749029feb4697197ae262/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:46.328558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a4edd412940fab6cdd1c1d6f2b637, user_id=04ba2464e57749029feb4697197ae262, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:46.331383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:46.376707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1090/2190] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:46 2022] PUT /identity/v3/projects/a29a4edd412940fab6cdd1c1d6f2b637/users/04ba2464e57749029feb4697197ae262/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:46.382236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:46.401934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c762-61e6-4aec-9019-01ac7ace13e1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:46.562011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2718d-8fd4-4179-801d-669b5e811539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:46.562749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2718d-8fd4-4179-801d-669b5e811539 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:46.562926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2718d-8fd4-4179-801d-669b5e811539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:46.563200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2718d-8fd4-4179-801d-669b5e811539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:46.563895 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2718d-8fd4-4179-801d-669b5e811539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:46.565509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2718d-8fd4-4179-801d-669b5e811539 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:46.604379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1101/2191] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:46.606471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:46.632482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770ba7e-1196-49ea-9d24-c8c2e28132d3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:46.646737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:46.647739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:46.647967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:46.648535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] PATH_INFO: `/v3/projects/a29a4edd412940fab6cdd1c1d6f2b637/users/04ba2464e57749029feb4697197ae262/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:46.653493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a4edd412940fab6cdd1c1d6f2b637, user_id=04ba2464e57749029feb4697197ae262, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:46.656408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:46.702015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1091/2192] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:46 2022] PUT /identity/v3/projects/a29a4edd412940fab6cdd1c1d6f2b637/users/04ba2464e57749029feb4697197ae262/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:46.714165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:46.714474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:46.714725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:46.798913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] MFA Rules not processed for user `04ba2464e57749029feb4697197ae262`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:46.803729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:46.953495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1102/2193] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:46.967723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:46.970087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:47.154612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb6f1-57e9-4804-802c-6b2f7ce3434a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:47.174919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f802ff-6114-4f27-8258-0bee176ba81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:47.175832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f802ff-6114-4f27-8258-0bee176ba81f service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:47.176493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f802ff-6114-4f27-8258-0bee176ba81f service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:47.177239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f802ff-6114-4f27-8258-0bee176ba81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:47.210828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f802ff-6114-4f27-8258-0bee176ba81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:47.214908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f802ff-6114-4f27-8258-0bee176ba81f service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:47.238583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1092/2194] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:47.963225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:48.022041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:48.088321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf30c01-3e9f-47a9-9683-f175fab699f3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:48.094962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:48.095877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:48.096670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:48.097122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] PATH_INFO: `/v3/users/a7f9736838164fc3986d1073edcedbcb` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:48.098817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f9736838164fc3986d1073edcedbcb)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:48.101104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:48.181142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f9736838164fc3986d1073edcedbcb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:48.191565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f9736838164fc3986d1073edcedbcb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:48.194322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f9736838164fc3986d1073edcedbcb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:48.201216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f9736838164fc3986d1073edcedbcb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:48.228477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f9736838164fc3986d1073edcedbcb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:48.250913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1103/2195] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:47 2022] DELETE /identity/v3/users/a7f9736838164fc3986d1073edcedbcb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:48.255999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:48.256548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:48.256548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:48.291353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:48.292680 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:48.389339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1093/2196] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:48.420602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:48.422414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:48.515185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e645b5f-7b79-4a24-adb3-a5ddea232bf2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:48.519337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61d3f-00c2-457f-8933-22a8d35e926e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:48.520383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61d3f-00c2-457f-8933-22a8d35e926e service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:48.520672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61d3f-00c2-457f-8933-22a8d35e926e service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:48.521307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61d3f-00c2-457f-8933-22a8d35e926e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:48.534720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61d3f-00c2-457f-8933-22a8d35e926e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:48.536387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61d3f-00c2-457f-8933-22a8d35e926e service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:48.557656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1104/2197] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:49.120669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:49.123597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:49.152476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821c262-940f-4b97-a4bb-d9d3893d0f00 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:49.174357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:49.175026 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:49.175304 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:49.175575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] PATH_INFO: `/v3/projects/5b43d7a2e20844eea7c6456f556d7bd8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:49.180530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b43d7a2e20844eea7c6456f556d7bd8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:49.182498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:49.251859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:49.252824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:49.253287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:49.264592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:49.290424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] MFA Rules not processed for user `41212e62ee6a4ccdacb1431525b53e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:49.292149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:49.297977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b43d7a2e20844eea7c6456f556d7bd8', 'request_id': 'req-1d87bd3c-b876-4208-82c1-a9d73d9824fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.313805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b43d7a2e20844eea7c6456f556d7bd8', 'request_id': 'req-1d87bd3c-b876-4208-82c1-a9d73d9824fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.323953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b43d7a2e20844eea7c6456f556d7bd8', 'request_id': 'req-1d87bd3c-b876-4208-82c1-a9d73d9824fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.344781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] The token cache is being invalidate because project 5b43d7a2e20844eea7c6456f556d7bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:49.345294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.345757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:49.346450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.348452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1094/2198] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:49 2022] DELETE /identity/v3/projects/5b43d7a2e20844eea7c6456f556d7bd8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:49.352985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:49.354548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:49.378587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1105/2199] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:49.394755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:49.397941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:49.470629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bd3c-b876-4208-82c1-a9d73d9824fe admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:49.483468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:49.484378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:49.484815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:49.485270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] PATH_INFO: `/v3/users/04ba2464e57749029feb4697197ae262` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:49.486951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ba2464e57749029feb4697197ae262)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:49.489313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:49.518665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f621a7-5a1a-44a7-b9a6-22fe5be9b529 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:49.527928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:49.529243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:49.529432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:49.529898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:49.533543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:49.575596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ba2464e57749029feb4697197ae262'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.586507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ba2464e57749029feb4697197ae262'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.587794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ba2464e57749029feb4697197ae262'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.588641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ba2464e57749029feb4697197ae262'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.608231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ba2464e57749029feb4697197ae262'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:49.647369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1095/2200] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:49 2022] DELETE /identity/v3/users/04ba2464e57749029feb4697197ae262 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:49.653154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:49.655673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3751-01fc-472c-b1ee-ddee8828861c service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:49.678148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1106/2201] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:50.111719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:50.113195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:50.187178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:50.232289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda12e0b-5576-46ea-af22-6b9ee98a02db admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:50.258559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:50.259191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.259489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.262643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] PATH_INFO: `/v3/projects/a29a4edd412940fab6cdd1c1d6f2b637` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.266497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29a4edd412940fab6cdd1c1d6f2b637)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:50.269773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:50.356194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29a4edd412940fab6cdd1c1d6f2b637', 'request_id': 'req-dc70c119-9757-4aed-b6a8-171c81295ce3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:50.365739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29a4edd412940fab6cdd1c1d6f2b637', 'request_id': 'req-dc70c119-9757-4aed-b6a8-171c81295ce3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:50.375112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29a4edd412940fab6cdd1c1d6f2b637', 'request_id': 'req-dc70c119-9757-4aed-b6a8-171c81295ce3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:50.393003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] The token cache is being invalidate because project a29a4edd412940fab6cdd1c1d6f2b637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:50.393579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:50.394580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc70c119-9757-4aed-b6a8-171c81295ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:50.396331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1096/2202] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:50 2022] DELETE /identity/v3/projects/a29a4edd412940fab6cdd1c1d6f2b637 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:50.401745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.402243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.402449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.424264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:50.425776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:50.517659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1107/2203] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:50.520150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.520456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.520740 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.547595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:50.548875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:50.561729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1097/2204] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:50.566174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:50.579464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf0740-716f-4af8-a1f2-dbde393dc0bb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:50.592173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:50.593115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.593411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.593820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.594774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:50.595157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:50.598066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:50.618799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1108/2205] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:50.619878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:50.637237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc4af-0c00-46fe-91ab-2cd6eaad7a09 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:50.646563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:50.646951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.647310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.647709 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.648585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:50.650871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:50.688771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1098/2206] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:50 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:50.693551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:50.700284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:50.710798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f615605-3392-427b-8fd4-a4b77aa90ce1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:50.832197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:50.832729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.833119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.833294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.834981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:50.838587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:50.877615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1109/2207] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:50 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:50.881780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:50.890827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:50.892715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:50.915769 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eeb904-0fb7-4979-9a63-25412587486c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:50.917683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7feb4-e164-4000-92c4-cd5dd3e334e1 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:50.926316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:50.927466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.927994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.928434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] PATH_INFO: `/v3/users/5ddb07f3a93849ec92dccc564eaab30f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.930843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddb07f3a93849ec92dccc564eaab30f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:50.933732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:50.939421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:50.941280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:50.941570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:50.944329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:50.945326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:50.948338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:50.985087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1099/2208] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:50.989247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.004906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac213-296d-4ea3-8a22-0e6e412a58f7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.012108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddb07f3a93849ec92dccc564eaab30f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:51.025039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddb07f3a93849ec92dccc564eaab30f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:51.034945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.035607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.035979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.036188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.036876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.038548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.045704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddb07f3a93849ec92dccc564eaab30f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:51.048690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddb07f3a93849ec92dccc564eaab30f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:51.056846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1100/2209] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:51.058013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.062276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:51.076531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1971bbd-cf99-4f46-93c3-37049497876e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.081305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-fe13c34a-94a7-463f-8aad-57b2b2327c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddb07f3a93849ec92dccc564eaab30f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:51.082413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54c037-08b6-441d-899d-6f62b1a5210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.083095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c037-08b6-441d-899d-6f62b1a5210c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.083386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c037-08b6-441d-899d-6f62b1a5210c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.083663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c037-08b6-441d-899d-6f62b1a5210c admin admin] PATH_INFO: `/v3/projects/18f4a97de6f948b5846cd25a491f905b/users/5939890ce25048c2a1cdb056a5b58625/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.100906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54c037-08b6-441d-899d-6f62b1a5210c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f4a97de6f948b5846cd25a491f905b, user_id=5939890ce25048c2a1cdb056a5b58625, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.103778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54c037-08b6-441d-899d-6f62b1a5210c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.108290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1110/2210] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:50 2022] DELETE /identity/v3/users/5ddb07f3a93849ec92dccc564eaab30f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:51.110572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.110943 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.111336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.124303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1101/2211] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:51 2022] PUT /identity/v3/projects/18f4a97de6f948b5846cd25a491f905b/users/5939890ce25048c2a1cdb056a5b58625/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:51.134522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.135168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.135636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.139450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:51.140823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:51.177557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] MFA Rules not processed for user `5939890ce25048c2a1cdb056a5b58625`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:51.178927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:51.218849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:51.244266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1111/2212] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:51.256636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.258234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:51.266458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1102/2213] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:51.270833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.272804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:51.282527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e1742-d906-4219-9fde-080c3c4b2de4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.288387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69f05-e4dd-4058-aa60-2cb153e1020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.289102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69f05-e4dd-4058-aa60-2cb153e1020d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.289455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69f05-e4dd-4058-aa60-2cb153e1020d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.289803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69f05-e4dd-4058-aa60-2cb153e1020d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.290474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f69f05-e4dd-4058-aa60-2cb153e1020d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.292932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f69f05-e4dd-4058-aa60-2cb153e1020d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.328941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1103/2214] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:51 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:51.329148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599375-6db9-4659-82bf-ce2fef197dd2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.330967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.331416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.331697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.351995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] MFA Rules not processed for user `abd1937e53d34b53b1415ae97f9a04bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:51.353352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:51.376589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.377213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.377496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.377804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.411611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1104/2215] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:51.412350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.450366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.452626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.464942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1112/2216] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:51.494078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d6c6-8690-4107-9dbd-de1dbafba9b7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.507250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.507250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.507250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.507250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.507679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.507934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.534665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1105/2217] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:51 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:51.539903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.553083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc83d29-d8d2-4e55-a17c-e0149b113e43 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.558681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.559575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.560183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.560818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.561632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.563856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.577413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1113/2218] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:51.582247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.597350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb66ec-851e-466d-8a84-1e056f922825 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.603483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.604323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.604595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.604880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] PATH_INFO: `/v3/projects/2843b2d58da04196b6cb74843443956e/users/198e4acd763a4172a68cbe69d5f0c288/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.624613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2843b2d58da04196b6cb74843443956e, user_id=198e4acd763a4172a68cbe69d5f0c288, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.630460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.659399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1106/2219] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:51 2022] PUT /identity/v3/projects/2843b2d58da04196b6cb74843443956e/users/198e4acd763a4172a68cbe69d5f0c288/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:51.660611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.679639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741dbe8-b602-4b4f-bae9-e822899f58e5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.793138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9eff1-0e1a-496e-b6e6-b1c32f10533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.793808 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9eff1-0e1a-496e-b6e6-b1c32f10533f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.794096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9eff1-0e1a-496e-b6e6-b1c32f10533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.794424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9eff1-0e1a-496e-b6e6-b1c32f10533f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.795140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9eff1-0e1a-496e-b6e6-b1c32f10533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.797276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9eff1-0e1a-496e-b6e6-b1c32f10533f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.799068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:51.828768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1114/2220] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:51.829975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:51.871466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb71a4-4baf-40bf-8764-aacc92ae3ac0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:51.880499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:51.881165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.881456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.881760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] PATH_INFO: `/v3/projects/2843b2d58da04196b6cb74843443956e/users/198e4acd763a4172a68cbe69d5f0c288/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.883893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2843b2d58da04196b6cb74843443956e, user_id=198e4acd763a4172a68cbe69d5f0c288, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:51.886926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:51.898928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1107/2221] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:51 2022] PUT /identity/v3/projects/2843b2d58da04196b6cb74843443956e/users/198e4acd763a4172a68cbe69d5f0c288/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:51.910891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:51.911226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:51.911514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:51.965337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] MFA Rules not processed for user `198e4acd763a4172a68cbe69d5f0c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:51.966871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:52.030453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:52.032697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:52.049360 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:52.063923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1115/2222] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:52.088377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:52.094132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:52.168980 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea556-cf61-4931-a6ac-dc2aa80b7cfd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:52.180118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:52.182471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:52.183623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:52.183906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] PATH_INFO: `/v3/projects/43014d6dad2d4cc6b88a50f64fabdfe4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:52.185992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43014d6dad2d4cc6b88a50f64fabdfe4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:52.187918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:52.190535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2501ca-93a4-4542-a809-ff6bff854f0e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:52.200928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b591be-a839-484c-a338-891532386438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:52.203993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b591be-a839-484c-a338-891532386438 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:52.204287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b591be-a839-484c-a338-891532386438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:52.204562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b591be-a839-484c-a338-891532386438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:52.225259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b591be-a839-484c-a338-891532386438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:52.226998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b591be-a839-484c-a338-891532386438 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:52.240190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1116/2223] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:44:52.264410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43014d6dad2d4cc6b88a50f64fabdfe4', 'request_id': 'req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.274197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43014d6dad2d4cc6b88a50f64fabdfe4', 'request_id': 'req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.282173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43014d6dad2d4cc6b88a50f64fabdfe4', 'request_id': 'req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.297057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] The token cache is being invalidate because project 43014d6dad2d4cc6b88a50f64fabdfe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:52.297421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.298257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e03bdca-74f8-46b2-a3b0-ed3210f64b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.301652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1108/2224] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:52 2022] DELETE /identity/v3/projects/43014d6dad2d4cc6b88a50f64fabdfe4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:52.778984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b591be-a839-484c-a338-891532386438 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:52.789875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b591be-a839-484c-a338-891532386438 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:52.847520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:52.848166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:52.848451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:52.848730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] PATH_INFO: `/v3/users/5939890ce25048c2a1cdb056a5b58625` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:52.849935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5939890ce25048c2a1cdb056a5b58625)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:52.851868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:52.878742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:52.902815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5939890ce25048c2a1cdb056a5b58625'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.910519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5939890ce25048c2a1cdb056a5b58625'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.911281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5939890ce25048c2a1cdb056a5b58625'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.911937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5939890ce25048c2a1cdb056a5b58625'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.935162 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5939890ce25048c2a1cdb056a5b58625'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:52.956251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1117/2225] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:52 2022] DELETE /identity/v3/users/5939890ce25048c2a1cdb056a5b58625 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:52.960653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:52.960946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:52.961222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:52.981306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:52.982582 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:53.062238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1109/2226] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:53.072091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:53.073527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:53.146896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661fb51-40fc-4703-a544-f05fe9b9f535 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:53.150931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:53.151563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:53.151850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:53.152129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:53.162984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:53.165387 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:53.177947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1118/2227] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:53.490734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:53.492446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:53.511938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aaf7b-8d90-4cdb-9798-b5f08f2ee1a5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:53.519433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:53.520375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:53.520856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:53.521210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] PATH_INFO: `/v3/projects/18f4a97de6f948b5846cd25a491f905b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:53.522526 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f4a97de6f948b5846cd25a491f905b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:53.529067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:53.585615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:53.608013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f4a97de6f948b5846cd25a491f905b', 'request_id': 'req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.614685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f4a97de6f948b5846cd25a491f905b', 'request_id': 'req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.620772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f4a97de6f948b5846cd25a491f905b', 'request_id': 'req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.645111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] The token cache is being invalidate because project 18f4a97de6f948b5846cd25a491f905b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:53.646113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.647100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.650904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1110/2228] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:53 2022] DELETE /identity/v3/projects/18f4a97de6f948b5846cd25a491f905b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:53.655932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:53.672250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbbf08-9264-4ebb-ab32-26dfc6415291 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:53.755849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:53.756657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:53.758378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:53.758378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] PATH_INFO: `/v3/users/198e4acd763a4172a68cbe69d5f0c288` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:53.758970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] RBAC: Authorizing `identity:delete_user(user_id=198e4acd763a4172a68cbe69d5f0c288)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:53.761537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:53.824202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198e4acd763a4172a68cbe69d5f0c288'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.825882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:53.836766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198e4acd763a4172a68cbe69d5f0c288'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.841571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198e4acd763a4172a68cbe69d5f0c288'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.843021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198e4acd763a4172a68cbe69d5f0c288'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.861529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9579b8b2-608d-4959-9f3d-bbf7a32d321f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198e4acd763a4172a68cbe69d5f0c288'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:53.877707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1119/2229] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:53 2022] DELETE /identity/v3/users/198e4acd763a4172a68cbe69d5f0c288 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:54.413050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:54.414996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:54.429221 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4fb95-c17a-4d30-a2fb-6fb04b7e5876 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:54.534575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:54.535291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:54.535840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:54.536120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] PATH_INFO: `/v3/projects/2843b2d58da04196b6cb74843443956e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:54.537483 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2843b2d58da04196b6cb74843443956e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:54.539644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:54.625407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2843b2d58da04196b6cb74843443956e', 'request_id': 'req-fb649f24-afe0-47e8-807b-c3d19885ef82'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:54.633205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2843b2d58da04196b6cb74843443956e', 'request_id': 'req-fb649f24-afe0-47e8-807b-c3d19885ef82'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:54.641792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2843b2d58da04196b6cb74843443956e', 'request_id': 'req-fb649f24-afe0-47e8-807b-c3d19885ef82'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:54.664234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] The token cache is being invalidate because project 2843b2d58da04196b6cb74843443956e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:54.664543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:54.665419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fb649f24-afe0-47e8-807b-c3d19885ef82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:54.667540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1111/2230] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:54 2022] DELETE /identity/v3/projects/2843b2d58da04196b6cb74843443956e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:54.672451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:54.672744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:54.673030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:54.720252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:54.722262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:54.813628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1120/2231] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:54.820763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:54.821045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:54.821318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:54.841765 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:54.842979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:54.851106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1112/2232] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:54.855312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:54.874242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b051f-1dd5-4ae8-8c3e-4c789b4c180b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:54.880117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:54.880834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:54.881188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:54.881709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:54.882643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:54.883015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:54.884695 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:54.902788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1121/2233] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:54.903916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:54.917458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee954838-fa4d-403b-98c7-1a883928ec50 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:54.924367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:54.925084 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:54.925442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:54.925813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:54.933011 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:54.935541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:54.999569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1113/2234] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:54 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:55.000998 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.017936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341fe6-8f69-48bd-8b7e-c979ca3cfd6e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.095617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.096291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.096582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.096830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.097710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.099691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.129216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1122/2235] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:54 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:55.133169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.143909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936f46d-e4d4-40d8-bfc5-53f1c43e560a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.148979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.149747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.150054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.150335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.151124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.152808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.164239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1114/2236] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:55.168731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.187059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be390-5622-4385-ba66-05b804016ff8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.192278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aca132-84b3-4ce7-8fb3-8d19a6689051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.193265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca132-84b3-4ce7-8fb3-8d19a6689051 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.193265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca132-84b3-4ce7-8fb3-8d19a6689051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.193463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca132-84b3-4ce7-8fb3-8d19a6689051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.194433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca132-84b3-4ce7-8fb3-8d19a6689051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.196793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca132-84b3-4ce7-8fb3-8d19a6689051 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.221168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1123/2237] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:55.225615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.240079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35471a91-f4eb-4c28-a2a0-1ac82a82f0c5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.256762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.258215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.259500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.260329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] PATH_INFO: `/v3/projects/af1f38b3843e4c4b9f73e80b1a0a3123/users/87b66d6cba524a879dc915b4346f739f/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.276541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:55.280719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1f38b3843e4c4b9f73e80b1a0a3123, user_id=87b66d6cba524a879dc915b4346f739f, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.283971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.303571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1115/2238] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:55 2022] PUT /identity/v3/projects/af1f38b3843e4c4b9f73e80b1a0a3123/users/87b66d6cba524a879dc915b4346f739f/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:55.314784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.315483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.316034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.382977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] MFA Rules not processed for user `87b66d6cba524a879dc915b4346f739f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:55.384335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:55.426189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:55.504002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1124/2239] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:55.505410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.593281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51203cb5-4a5d-4a66-a342-207225496bd1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.600277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.602195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.602517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.602758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.603437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.605372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.644145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1116/2240] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:55 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:55.651473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.662968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99219da8-a2fa-4c4a-957b-7ff26ab5e1c1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.742935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.743594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.744014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.744415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.745448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.748605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.777920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1125/2241] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:55 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:55.778876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.789259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f83a7d-c933-41a2-9170-bec521e7987a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.794786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.795884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.796177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.796457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.797158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.798917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.811624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1117/2242] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:55.816045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.827719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ec3a-a2b5-4ceb-8b0a-4b9570a6d57d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.837037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.837784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.838074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.838356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] PATH_INFO: `/v3/projects/63a18f69a59a47688456e581116cb263/users/8f2e1a5e6ee5412d94b78f85e1b6b715/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.854280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a18f69a59a47688456e581116cb263, user_id=8f2e1a5e6ee5412d94b78f85e1b6b715, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.857027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.869774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1126/2243] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:55 2022] PUT /identity/v3/projects/63a18f69a59a47688456e581116cb263/users/8f2e1a5e6ee5412d94b78f85e1b6b715/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:55.873848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.884216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c9d2-be22-44bb-92d7-95b4a60dd23f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.955087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3601fe-084a-4d0d-8c8c-f85ed7fbfa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.955761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3601fe-084a-4d0d-8c8c-f85ed7fbfa89 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.956046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3601fe-084a-4d0d-8c8c-f85ed7fbfa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.956320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3601fe-084a-4d0d-8c8c-f85ed7fbfa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.957015 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3601fe-084a-4d0d-8c8c-f85ed7fbfa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.958640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3601fe-084a-4d0d-8c8c-f85ed7fbfa89 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:55.973662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1118/2244] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:55.975144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:55.985314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c929a29-a319-4231-9783-fc9289ecb811 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:55.989888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:55.990536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:55.990814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:55.991089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] PATH_INFO: `/v3/projects/63a18f69a59a47688456e581116cb263/users/8f2e1a5e6ee5412d94b78f85e1b6b715/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:55.993001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a18f69a59a47688456e581116cb263, user_id=8f2e1a5e6ee5412d94b78f85e1b6b715, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:55.995686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:56.005610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1127/2245] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:55 2022] PUT /identity/v3/projects/63a18f69a59a47688456e581116cb263/users/8f2e1a5e6ee5412d94b78f85e1b6b715/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:56.017515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:56.017836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:56.018124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:56.051206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] MFA Rules not processed for user `8f2e1a5e6ee5412d94b78f85e1b6b715`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:56.053228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:56.110569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:56.132257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1119/2246] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:56.144741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:56.146486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:56.205780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9aace-047e-4c2a-ac8b-f95d35ac16ca admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:56.209428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341ea7-9796-4237-80f4-76692189eb45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:56.210074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341ea7-9796-4237-80f4-76692189eb45 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:56.210360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341ea7-9796-4237-80f4-76692189eb45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:56.210641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341ea7-9796-4237-80f4-76692189eb45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:56.219517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d341ea7-9796-4237-80f4-76692189eb45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:56.220944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d341ea7-9796-4237-80f4-76692189eb45 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:56.230320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1128/2247] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:56.297107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:56.365117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566397-6821-45b8-89d4-c9519ed1a940 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:56.370784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:56.373661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:56.373661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:56.373661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] PATH_INFO: `/v3/users/87b66d6cba524a879dc915b4346f739f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:56.377496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b66d6cba524a879dc915b4346f739f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:56.378540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:56.459272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b66d6cba524a879dc915b4346f739f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:56.469763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b66d6cba524a879dc915b4346f739f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:56.471120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b66d6cba524a879dc915b4346f739f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:56.472335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b66d6cba524a879dc915b4346f739f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:56.490350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b66d6cba524a879dc915b4346f739f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:56.506938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1120/2248] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:56 2022] DELETE /identity/v3/users/87b66d6cba524a879dc915b4346f739f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:56.511692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:56.512057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:56.512406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:56.539401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:56.540655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:56.552690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:56.607112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1129/2249] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:44:56.619108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:56.620529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:56.678085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369cd6a-a0ea-4544-86e1-a2c9d70a5055 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:56.681830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:56.682441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:56.682723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:56.682992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:56.693129 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:56.694580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:56.704189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1121/2250] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:44:57.083677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:57.085335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:57.104507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6728e0-be4d-46e0-b6cf-ee0597c5696a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:57.111065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:57.111698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:57.111989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:57.112249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] PATH_INFO: `/v3/projects/af1f38b3843e4c4b9f73e80b1a0a3123` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:57.113431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1f38b3843e4c4b9f73e80b1a0a3123)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:57.115356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:57.165075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1f38b3843e4c4b9f73e80b1a0a3123', 'request_id': 'req-9520211a-1948-4d76-b2a3-f5f503503a6f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.171911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1f38b3843e4c4b9f73e80b1a0a3123', 'request_id': 'req-9520211a-1948-4d76-b2a3-f5f503503a6f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.179721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1f38b3843e4c4b9f73e80b1a0a3123', 'request_id': 'req-9520211a-1948-4d76-b2a3-f5f503503a6f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.194151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] The token cache is being invalidate because project af1f38b3843e4c4b9f73e80b1a0a3123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:57.194442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.195382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.196697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1130/2251] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:57 2022] DELETE /identity/v3/projects/af1f38b3843e4c4b9f73e80b1a0a3123 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:57.200957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:57.210703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5ddf-6dd6-44ee-a522-bccb649e2ed1 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:57.216999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:57.280933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:57.281657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:57.282077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:57.282358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] PATH_INFO: `/v3/users/8f2e1a5e6ee5412d94b78f85e1b6b715` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:57.283558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2e1a5e6ee5412d94b78f85e1b6b715)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:57.285479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:57.344703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2e1a5e6ee5412d94b78f85e1b6b715'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.352354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2e1a5e6ee5412d94b78f85e1b6b715'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.353075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2e1a5e6ee5412d94b78f85e1b6b715'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.353718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2e1a5e6ee5412d94b78f85e1b6b715'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.368566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-48de7264-f6b9-4609-a8a9-4817ba316ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2e1a5e6ee5412d94b78f85e1b6b715'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.387070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1122/2252] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:44:57 2022] DELETE /identity/v3/users/8f2e1a5e6ee5412d94b78f85e1b6b715 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:57.674122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:57.675723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:57.689898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520211a-1948-4d76-b2a3-f5f503503a6f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:57.754389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:57.755130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:57.755743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:57.755872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] PATH_INFO: `/v3/projects/63a18f69a59a47688456e581116cb263` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:57.757348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a18f69a59a47688456e581116cb263)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:57.759457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:57.807038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:57.816239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a18f69a59a47688456e581116cb263', 'request_id': 'req-bcc0b386-eeaa-4831-abac-471ac4443a10'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.824558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a18f69a59a47688456e581116cb263', 'request_id': 'req-bcc0b386-eeaa-4831-abac-471ac4443a10'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.830805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a18f69a59a47688456e581116cb263', 'request_id': 'req-bcc0b386-eeaa-4831-abac-471ac4443a10'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.847958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] The token cache is being invalidate because project 63a18f69a59a47688456e581116cb263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:44:57.848286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.849076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bcc0b386-eeaa-4831-abac-471ac4443a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:44:57.862351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1131/2253] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:44:57 2022] DELETE /identity/v3/projects/63a18f69a59a47688456e581116cb263 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:57.862466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:57.862466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:57.862466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:57.876422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:57.877688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:57.954775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1123/2254] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:57.962782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:57.963071 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:57.963353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:57.982685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:57.983891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:57.992249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1132/2255] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:57.996489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.007387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5837-ba0a-421e-b85f-46a31a0a69b0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.012070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.013318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.013613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.013907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.014602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:44:58.014909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.016505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.027883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1124/2256] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:44:58.032265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.041502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973616fc-aca6-4bfe-9a71-7d4bf841d48c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.046116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.046717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.046994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.047267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.047931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.049854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.077173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1133/2257] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:58.081710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.091818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d8a0-a388-494e-8f96-df97be642f31 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.101211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:58.157636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.158168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.158457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.158735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.159436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.161352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.182819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1125/2258] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:58.187581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.197888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c0c4-afd6-4680-9548-71e3e3046148 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.202508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.203114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.203396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.203672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.204407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.205992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.216017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1134/2259] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:58.220039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.229966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4805e-3966-48b6-bac9-5711d06ec590 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.234965 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562374-d638-491c-8c17-88998bb6c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.235557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562374-d638-491c-8c17-88998bb6c047 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.235837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562374-d638-491c-8c17-88998bb6c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.236117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562374-d638-491c-8c17-88998bb6c047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.236791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562374-d638-491c-8c17-88998bb6c047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.238479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562374-d638-491c-8c17-88998bb6c047 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.249448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1126/2260] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:58.253376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.263352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0bc7c-d499-4664-b249-cd65a1eb8749 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.267984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.268635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.268919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.269195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] PATH_INFO: `/v3/projects/eca59fffcb0d40e286a416d1a1848d0b/users/b2d1d284ac8940ac93fdc413169bddf2/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.283457 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca59fffcb0d40e286a416d1a1848d0b, user_id=b2d1d284ac8940ac93fdc413169bddf2, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.286131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.298739 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1135/2261] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:58 2022] PUT /identity/v3/projects/eca59fffcb0d40e286a416d1a1848d0b/users/b2d1d284ac8940ac93fdc413169bddf2/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:58.309057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.309354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.310376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.337136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] MFA Rules not processed for user `b2d1d284ac8940ac93fdc413169bddf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:58.338397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:58.402512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1127/2262] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:58.407007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.487587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2375f-f58d-4728-a98c-fcb3c3ad15f5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.492541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.493104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.493285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.493675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.494422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.497110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.537833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1136/2263] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:58.539021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.552825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffac96-9986-4cdc-93f4-b3aae0cd42a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.632504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.633967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.634252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.634531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.635199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.637136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.665585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1128/2264] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:58.669950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.685937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9ef48-14e1-41c3-bf51-c71850cef8d3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.690870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.691538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.691833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.692113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.692814 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.694462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.707964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1137/2265] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:58.712236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.725018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8613b4-639a-47cc-b62b-eca7b6953872 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.729753 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01be40-975d-4bf0-bcb9-9901a8f0262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.730355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01be40-975d-4bf0-bcb9-9901a8f0262a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.730643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01be40-975d-4bf0-bcb9-9901a8f0262a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.730925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01be40-975d-4bf0-bcb9-9901a8f0262a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.731652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01be40-975d-4bf0-bcb9-9901a8f0262a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.733277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01be40-975d-4bf0-bcb9-9901a8f0262a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.738816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:58.748426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1129/2266] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:58.749529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.761955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256ce9-ea76-44e9-a599-c7d553b60d83 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:58.767564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:58.768431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.768715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.769074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] PATH_INFO: `/v3/projects/41eae70d0cec49c4be6e785f2a6fa5ff/users/64ca1b1e72e346b49ff78d78a6882a8e/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.786267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=41eae70d0cec49c4be6e785f2a6fa5ff, user_id=64ca1b1e72e346b49ff78d78a6882a8e, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:58.788962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:58.808905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1138/2267] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:58 2022] PUT /identity/v3/projects/41eae70d0cec49c4be6e785f2a6fa5ff/users/64ca1b1e72e346b49ff78d78a6882a8e/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:58.820671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:58.820966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:58.821249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:58.851926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] MFA Rules not processed for user `64ca1b1e72e346b49ff78d78a6882a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:58.853179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:58.928839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1130/2268] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:58.930528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:58.965781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:59.021546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed061-c806-4c84-94fa-2b13f2d4eadc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.028763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.029514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.029985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.030328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.031060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.033156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.073022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1139/2269] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:44:58 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:44:59.074215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:59.085858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18479427-36ea-47ed-9647-63617c1e4fc8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.168166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.168919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.169291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.169671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.170429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.172509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.202990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1131/2270] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:44:59 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:44:59.204631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:59.221273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85532-5dd3-41c6-a77b-08796d9096cb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.234414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.235198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.235569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.235914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.236945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.238687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.253983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1140/2271] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:44:59.255976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:59.267506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6166e-5da1-47f9-991f-332c2d43609f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.272939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.273720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.274008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.274347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] PATH_INFO: `/v3/projects/7f8553198b834e7a94544d582169fae3/users/be01630728304020b03151747835017f/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.291057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8553198b834e7a94544d582169fae3, user_id=be01630728304020b03151747835017f, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.293817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.308017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1132/2272] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:59 2022] PUT /identity/v3/projects/7f8553198b834e7a94544d582169fae3/users/be01630728304020b03151747835017f/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:44:59.312707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:59.324949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc862-852f-49e4-af32-dd606382b062 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.382021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc9181-a287-48db-87f8-990cdd985671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.382679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc9181-a287-48db-87f8-990cdd985671 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.382963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc9181-a287-48db-87f8-990cdd985671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.383238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc9181-a287-48db-87f8-990cdd985671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.384008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc9181-a287-48db-87f8-990cdd985671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.385731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc9181-a287-48db-87f8-990cdd985671 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.396845 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1141/2273] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:44:59.401583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:59.412801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad890-2e49-4cdd-b342-1bbe8e256c60 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.417391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.418089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.418374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.418651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] PATH_INFO: `/v3/projects/7f8553198b834e7a94544d582169fae3/users/be01630728304020b03151747835017f/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.420623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8553198b834e7a94544d582169fae3, user_id=be01630728304020b03151747835017f, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.423448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.433984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1133/2274] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:44:59 2022] PUT /identity/v3/projects/7f8553198b834e7a94544d582169fae3/users/be01630728304020b03151747835017f/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:44:59.444660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.445077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.445541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.476843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] MFA Rules not processed for user `be01630728304020b03151747835017f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:44:59.478257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:59.551428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1142/2275] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:44:59.562827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:44:59.564522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:44:59.615018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:44:59.630014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa077-c874-4b8d-810d-896fbe87c2b6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:44:59.633687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:44:59.634430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:44:59.634712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:44:59.634988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:44:59.644319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:44:59.645832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:44:59.655430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1134/2276] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:45:00.190359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:00.191776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:00.203500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b6dae-1360-4bbe-acc2-8385dfe344bf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:00.207130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:00.207690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:00.207949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:00.208228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:00.217982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:00.268851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:00.270336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:00.279977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1143/2277] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:05.410908 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:05.420952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888602f-3f31-4bd0-a88a-488bedb73ec0 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:05.426407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:05.427445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:05.427742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:05.428057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:05.487920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:05.489361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:05.499433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1135/2278] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:05.551560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:05.553624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:05.639798 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41276-2ed9-4bd6-897a-6d3f6fc4c909 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:05.644367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:05.644996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:05.645277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:05.645561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] PATH_INFO: `/v3/users/573f00f5af6a4ebfbd932224343db530` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:05.646873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] RBAC: Authorizing `identity:delete_user(user_id=573f00f5af6a4ebfbd932224343db530)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:05.648790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:05.705189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573f00f5af6a4ebfbd932224343db530'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:05.712256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573f00f5af6a4ebfbd932224343db530'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:05.713044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573f00f5af6a4ebfbd932224343db530'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:05.713760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573f00f5af6a4ebfbd932224343db530'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:05.728624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573f00f5af6a4ebfbd932224343db530'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:05.744226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1144/2279] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:05 2022] DELETE /identity/v3/users/573f00f5af6a4ebfbd932224343db530 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:05.943852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:05.980888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef584-3a09-4b44-a761-06c02a9e7fe6 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:06.066993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:06.067801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.068111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.068457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] PATH_INFO: `/v3/projects/4f2b2bcdd0d74285931c38eb0e1be3f8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.069927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2b2bcdd0d74285931c38eb0e1be3f8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:06.072619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:06.142978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2b2bcdd0d74285931c38eb0e1be3f8', 'request_id': 'req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.149937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2b2bcdd0d74285931c38eb0e1be3f8', 'request_id': 'req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.156788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2b2bcdd0d74285931c38eb0e1be3f8', 'request_id': 'req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.171117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] The token cache is being invalidate because project 4f2b2bcdd0d74285931c38eb0e1be3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:06.171583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.172394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.173983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1136/2280] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:05 2022] DELETE /identity/v3/projects/4f2b2bcdd0d74285931c38eb0e1be3f8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:06.178464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:06.179923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:06.198367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6492c-9dc0-4b74-9a5d-c6f7a925016a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:06.230907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:06.267654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:06.268420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.268730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.269005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] PATH_INFO: `/v3/users/c322985d388b40c286837cab551d6d9c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.270255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c322985d388b40c286837cab551d6d9c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:06.272166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:06.324632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c322985d388b40c286837cab551d6d9c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.331919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c322985d388b40c286837cab551d6d9c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.332586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c322985d388b40c286837cab551d6d9c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.333197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c322985d388b40c286837cab551d6d9c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.345711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-c00c3532-6513-4753-b836-e2aa980c4fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c322985d388b40c286837cab551d6d9c'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.359574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1145/2281] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:06 2022] DELETE /identity/v3/users/c322985d388b40c286837cab551d6d9c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:45:06.539839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:06.541383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:06.554693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc91cc-f03e-4018-80d3-d3cd13c5f818 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:06.564155 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:06.614959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:06.615736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.616048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.616324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] PATH_INFO: `/v3/projects/e8c2c4c8903841fdab861aa4d8543dbd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.617484 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c2c4c8903841fdab861aa4d8543dbd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:06.619415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:06.666831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c2c4c8903841fdab861aa4d8543dbd', 'request_id': 'req-37bc0e0a-93c2-47f1-85a7-184d2db31d92'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.673004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c2c4c8903841fdab861aa4d8543dbd', 'request_id': 'req-37bc0e0a-93c2-47f1-85a7-184d2db31d92'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.678741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c2c4c8903841fdab861aa4d8543dbd', 'request_id': 'req-37bc0e0a-93c2-47f1-85a7-184d2db31d92'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.691150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] The token cache is being invalidate because project e8c2c4c8903841fdab861aa4d8543dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:06.691489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.692112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-37bc0e0a-93c2-47f1-85a7-184d2db31d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:06.693704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1137/2282] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:06 2022] DELETE /identity/v3/projects/e8c2c4c8903841fdab861aa4d8543dbd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:06.698982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76343-dd0b-489d-b302-355613711d4d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.699581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76343-dd0b-489d-b302-355613711d4d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.699581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76343-dd0b-489d-b302-355613711d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.720710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-58f76343-dd0b-489d-b302-355613711d4d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:06.722211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-58f76343-dd0b-489d-b302-355613711d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:06.783619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1146/2283] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:06.792123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.792415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.792706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.813056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:06.814310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:06.822280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1138/2284] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:06.826409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f76343-dd0b-489d-b302-355613711d4d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:06.836078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f76343-dd0b-489d-b302-355613711d4d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:06.840632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:06.841244 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.842067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.842348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.843053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:45:06.843356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:06.844949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:06.856323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1147/2285] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:45:06.861460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:06.872862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a4b25-6d5a-4229-8f6e-6ec21571ee9f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:06.877922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:06.878578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.878861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.879137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.879811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:06.881750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:06.909105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1139/2286] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:45:06 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:06.913274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:06.923978 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a48b1-4faa-41b5-a729-f77c893620d2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:06.957992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:06.992073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:06.992702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:06.992988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:06.993264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:06.993985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:06.995940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:07.024555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1148/2287] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:45:06 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:07.025758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:07.036599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42b32-232b-4059-90ed-5617c5e48e36 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:07.041246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:07.041878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.042162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.042440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.043128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:07.045272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:07.056330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1140/2288] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:07.062999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:07.074377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8d10f-d916-4b07-b956-57fcbf69b942 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:07.080159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e445a-74f9-4ba4-b484-daf37b4e9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:07.080578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e445a-74f9-4ba4-b484-daf37b4e9f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.080897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e445a-74f9-4ba4-b484-daf37b4e9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.081283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e445a-74f9-4ba4-b484-daf37b4e9f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.082069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e445a-74f9-4ba4-b484-daf37b4e9f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:07.083961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e445a-74f9-4ba4-b484-daf37b4e9f7e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:07.096314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1149/2289] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:07.100535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:07.110827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9882d5-baa0-45ee-8eab-951fc90ffed9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:07.115459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:07.116183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.116536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.116879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] PATH_INFO: `/v3/projects/1a118e5b3d724cfda9309bafc2de39aa/users/ae638af5bc4948e9aae18242059f2896/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.131222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a118e5b3d724cfda9309bafc2de39aa, user_id=ae638af5bc4948e9aae18242059f2896, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:07.133899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:07.146840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1141/2290] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:45:07 2022] PUT /identity/v3/projects/1a118e5b3d724cfda9309bafc2de39aa/users/ae638af5bc4948e9aae18242059f2896/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:45:07.157791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.158065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.158358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.194047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] MFA Rules not processed for user `ae638af5bc4948e9aae18242059f2896`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:07.196016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:07.265232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1150/2291] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:07.276391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:07.278144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:07.334257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:07.358914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b88d54-56b4-438b-8c81-bd8cd56d5846 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:07.362659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822721-bb7c-4587-b0c3-220afb005e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:07.363352 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822721-bb7c-4587-b0c3-220afb005e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.363707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822721-bb7c-4587-b0c3-220afb005e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.364054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822721-bb7c-4587-b0c3-220afb005e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.372493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822721-bb7c-4587-b0c3-220afb005e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:07.374009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822721-bb7c-4587-b0c3-220afb005e6c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:07.387443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1142/2292] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:07.779263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:07.781205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:07.847562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15f4b-3d43-488b-8112-d00c299d6d2f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:07.852369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:07.852999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.853290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.853569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] PATH_INFO: `/v3/users/b2d1d284ac8940ac93fdc413169bddf2` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.854976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d1d284ac8940ac93fdc413169bddf2)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:07.857763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:07.903729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:07.905359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d1d284ac8940ac93fdc413169bddf2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:07.913495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d1d284ac8940ac93fdc413169bddf2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:07.914365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d1d284ac8940ac93fdc413169bddf2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:07.915076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d1d284ac8940ac93fdc413169bddf2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:07.927796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d1d284ac8940ac93fdc413169bddf2'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:07.941022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1151/2293] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:07 2022] DELETE /identity/v3/users/b2d1d284ac8940ac93fdc413169bddf2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:07.945611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:07.946078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:07.946191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:07.965800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:07.966995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:08.024862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1143/2294] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:08.035001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:08.036476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:08.100834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35823-d8bb-4761-a417-4fe780074ebe admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:08.104378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:08.104989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:08.105274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:08.105554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:08.115109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:08.116533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:08.126571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1152/2295] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:08.402190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:08.403981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:08.419379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edccc-f27a-46d1-ad1c-e1f008dab783 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:08.424543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:08.425664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:08.426187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:08.426683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] PATH_INFO: `/v3/projects/eca59fffcb0d40e286a416d1a1848d0b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:08.428308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca59fffcb0d40e286a416d1a1848d0b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:08.430452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:08.483117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca59fffcb0d40e286a416d1a1848d0b', 'request_id': 'req-e9e9a056-99c7-43f3-90b7-1916ea581ae6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.489676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca59fffcb0d40e286a416d1a1848d0b', 'request_id': 'req-e9e9a056-99c7-43f3-90b7-1916ea581ae6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.495286 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca59fffcb0d40e286a416d1a1848d0b', 'request_id': 'req-e9e9a056-99c7-43f3-90b7-1916ea581ae6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.509499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] The token cache is being invalidate because project eca59fffcb0d40e286a416d1a1848d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:08.509907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.510859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.512433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1144/2296] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:08 2022] DELETE /identity/v3/projects/eca59fffcb0d40e286a416d1a1848d0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:08.517173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:08.535627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb88e-caad-4304-b165-9cd68e94eed2 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:08.593062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:08.593726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:08.594009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:08.594283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] PATH_INFO: `/v3/users/64ca1b1e72e346b49ff78d78a6882a8e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:08.595427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ca1b1e72e346b49ff78d78a6882a8e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:08.597359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:08.642554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ca1b1e72e346b49ff78d78a6882a8e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.649491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ca1b1e72e346b49ff78d78a6882a8e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.650192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ca1b1e72e346b49ff78d78a6882a8e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.650823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ca1b1e72e346b49ff78d78a6882a8e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.658639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:08.664298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ca1b1e72e346b49ff78d78a6882a8e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:08.678256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1153/2297] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:08 2022] DELETE /identity/v3/users/64ca1b1e72e346b49ff78d78a6882a8e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:08.955532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:08.957134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:08.971232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9a056-99c7-43f3-90b7-1916ea581ae6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:09.033854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:09.034500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.034784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.035091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] PATH_INFO: `/v3/projects/41eae70d0cec49c4be6e785f2a6fa5ff` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.036270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41eae70d0cec49c4be6e785f2a6fa5ff)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:09.038328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:09.047523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:09.086781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41eae70d0cec49c4be6e785f2a6fa5ff', 'request_id': 'req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.093739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41eae70d0cec49c4be6e785f2a6fa5ff', 'request_id': 'req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.099787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41eae70d0cec49c4be6e785f2a6fa5ff', 'request_id': 'req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.113289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] The token cache is being invalidate because project 41eae70d0cec49c4be6e785f2a6fa5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:09.113617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.114260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.115802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1145/2298] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:08 2022] DELETE /identity/v3/projects/41eae70d0cec49c4be6e785f2a6fa5ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:09.120011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:09.121558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:09.134406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649213d-fd4b-4034-9a9f-da6f7a2aadfe admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:09.191612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:09.192257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.192543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.192835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] PATH_INFO: `/v3/users/be01630728304020b03151747835017f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.194053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be01630728304020b03151747835017f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:09.195969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:09.249624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be01630728304020b03151747835017f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.256305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be01630728304020b03151747835017f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.257036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be01630728304020b03151747835017f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.257678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be01630728304020b03151747835017f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.269451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5e421e11-db91-4cc2-8354-cb94f28925d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be01630728304020b03151747835017f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.282642 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1154/2299] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:09 2022] DELETE /identity/v3/users/be01630728304020b03151747835017f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:45:09.572536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:09.574308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:09.607807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08dd0-345e-4b7c-84a0-fcd579ef3c72 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:09.675342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:09.676004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.676295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.676608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] PATH_INFO: `/v3/projects/7f8553198b834e7a94544d582169fae3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.678114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8553198b834e7a94544d582169fae3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:09.680056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:09.736117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8553198b834e7a94544d582169fae3', 'request_id': 'req-077a80ca-a480-43b6-8d90-78a24fc48fe8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.742641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8553198b834e7a94544d582169fae3', 'request_id': 'req-077a80ca-a480-43b6-8d90-78a24fc48fe8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.748922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8553198b834e7a94544d582169fae3', 'request_id': 'req-077a80ca-a480-43b6-8d90-78a24fc48fe8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.762069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] The token cache is being invalidate because project 7f8553198b834e7a94544d582169fae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:09.762369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.763007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-077a80ca-a480-43b6-8d90-78a24fc48fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:09.765154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1146/2300] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:09 2022] DELETE /identity/v3/projects/7f8553198b834e7a94544d582169fae3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:09.772110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.772407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.772689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.793103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:09.794424 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:09.879908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1155/2301] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:09.889852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.890172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.890453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.911021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:09.912255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:09.922158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1147/2302] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:09.927964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:09.934704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:09.940968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce6a3-0273-4888-b661-398ddaadcac2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:09.948594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:09.950498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.951774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.952218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.953769 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:45:09.954121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:09.956682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:09.971007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1156/2303] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:45:09.975544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:09.986192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23453159-d88b-4d0a-9a45-815b7879945f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:09.991660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:09.992324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:09.992612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:09.992894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:09.993576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:09.995551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.022137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:10.036792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1148/2304] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:45:09 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:10.040525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.053155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf6277-ebb3-4225-a575-fae43861650d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.130334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.131073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.131364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.131638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.132302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.134259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.164917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1157/2305] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:45:10 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:10.166734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.179948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87466-c163-40cc-8065-47c26b8f24c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.184895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.186601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.186951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.187301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.188141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.189817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.203387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1149/2306] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:10.207185 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.217124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89d36-be06-4787-aae8-93854e0983a2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.222655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61508fe-0ed6-4dd2-b62d-ec57c45f8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.223213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61508fe-0ed6-4dd2-b62d-ec57c45f8acb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.223502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61508fe-0ed6-4dd2-b62d-ec57c45f8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.223789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61508fe-0ed6-4dd2-b62d-ec57c45f8acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.224640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61508fe-0ed6-4dd2-b62d-ec57c45f8acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.226543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61508fe-0ed6-4dd2-b62d-ec57c45f8acb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.241631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1158/2307] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:10.243579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.257004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e7826-ec5e-4425-a5ff-9428e9a9c890 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.262165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.262835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.263124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.263446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] PATH_INFO: `/v3/projects/6447320bb6b9452d96f886a22a11e9ca/users/83d55abc7f4c42cf9935dc9348e31fc3/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.285134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6447320bb6b9452d96f886a22a11e9ca, user_id=83d55abc7f4c42cf9935dc9348e31fc3, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.287825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.301206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1150/2308] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:45:10 2022] PUT /identity/v3/projects/6447320bb6b9452d96f886a22a11e9ca/users/83d55abc7f4c42cf9935dc9348e31fc3/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:10.313818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.314664 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.314823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.345393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] MFA Rules not processed for user `83d55abc7f4c42cf9935dc9348e31fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:10.346789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:10.413947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1159/2309] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:10.425822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.427771 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:10.486764 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931145b-218c-48d8-ab2d-25c1a58ac266 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.490456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc19b-1099-496a-85d5-e63d639aa903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.491068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc19b-1099-496a-85d5-e63d639aa903 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.491355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc19b-1099-496a-85d5-e63d639aa903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.491637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc19b-1099-496a-85d5-e63d639aa903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.499851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc19b-1099-496a-85d5-e63d639aa903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.501279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc19b-1099-496a-85d5-e63d639aa903 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.510065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1151/2310] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:10.532178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.594605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670450f-f5c7-4d93-bd22-a17e206bbdc3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.599284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.600264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.600585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.600869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] PATH_INFO: `/v3/users/83d55abc7f4c42cf9935dc9348e31fc3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.602090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d55abc7f4c42cf9935dc9348e31fc3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.604013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.605693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:10.651855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d55abc7f4c42cf9935dc9348e31fc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:10.659278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d55abc7f4c42cf9935dc9348e31fc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:10.659956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d55abc7f4c42cf9935dc9348e31fc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:10.660593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d55abc7f4c42cf9935dc9348e31fc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:10.672761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d55abc7f4c42cf9935dc9348e31fc3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:10.685878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1160/2311] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:10 2022] DELETE /identity/v3/users/83d55abc7f4c42cf9935dc9348e31fc3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:10.690466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.691115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.691432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.712751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:10.714016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:10.781589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1152/2312] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:10.791841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:10.793264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:10.856611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772424-26d3-44a7-96d8-0388f28b0abe admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:10.861072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566674e-7c14-4e50-a4b9-ee125f67c024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:10.861731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566674e-7c14-4e50-a4b9-ee125f67c024 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:10.862021 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566674e-7c14-4e50-a4b9-ee125f67c024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:10.862300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566674e-7c14-4e50-a4b9-ee125f67c024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:10.879422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566674e-7c14-4e50-a4b9-ee125f67c024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:10.881055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566674e-7c14-4e50-a4b9-ee125f67c024 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:10.892475 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1161/2313] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:11.182727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.184307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:11.200094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2fa94-e11f-48e7-b25b-63d0b42122a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.207989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.208723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.209884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.210245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] PATH_INFO: `/v3/projects/6447320bb6b9452d96f886a22a11e9ca` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.211952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6447320bb6b9452d96f886a22a11e9ca)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.216389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.270936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6447320bb6b9452d96f886a22a11e9ca', 'request_id': 'req-71d79cfe-d70c-40b0-ad79-06d2798801fb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:11.277147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6447320bb6b9452d96f886a22a11e9ca', 'request_id': 'req-71d79cfe-d70c-40b0-ad79-06d2798801fb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:11.283563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:11.284887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6447320bb6b9452d96f886a22a11e9ca', 'request_id': 'req-71d79cfe-d70c-40b0-ad79-06d2798801fb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:11.298168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] The token cache is being invalidate because project 6447320bb6b9452d96f886a22a11e9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:11.298540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:11.299269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71d79cfe-d70c-40b0-ad79-06d2798801fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:11.300891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1153/2314] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:11 2022] DELETE /identity/v3/projects/6447320bb6b9452d96f886a22a11e9ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:11.308932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.308932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.308932 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.334960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:11.336205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:11.394588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1162/2315] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:11.402256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.402593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.402871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.424625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:11.425876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:11.433929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1154/2316] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:11.441074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.452333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de245aa-5272-4c26-bce9-da3d4fbb5fee None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.457038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.457684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.457969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.458242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.459024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:45:11.459361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.460967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.473355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1163/2317] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:45:11.477913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.487427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720c6aa-fe13-4f23-8e4c-900f2dc37996 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.491975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.492578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.492857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.493133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.493813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.495699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.523638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1155/2318] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:45:11 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:11.528370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.539721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7da1b-e04e-4513-9cb7-60498a5bca39 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.544879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:11.598512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.599126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.599407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.599683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.600352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.602322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.624911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1164/2319] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:45:11 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:11.629112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.639886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df6fac-8968-4440-bc25-0f497954cb04 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.644894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.645519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.646002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.646519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.647369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.648974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.659169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1156/2320] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:11.663225 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.673804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89ec1-076b-4bba-aa5e-9179031d2b75 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.678752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847d26-ae6a-498c-ab2c-aec17c4f1755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.679369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847d26-ae6a-498c-ab2c-aec17c4f1755 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.679656 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847d26-ae6a-498c-ab2c-aec17c4f1755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.679938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847d26-ae6a-498c-ab2c-aec17c4f1755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.680643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847d26-ae6a-498c-ab2c-aec17c4f1755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.682288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847d26-ae6a-498c-ab2c-aec17c4f1755 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.693801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1165/2321] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:11.697955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.708231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76e1aa-6c42-4f4f-a6c1-98618515a9d4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:11.712794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:11.713449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.713773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.714050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] PATH_INFO: `/v3/projects/d1521517be244e36887cd3e6c699a342/users/3aea42a7b62547f39cf3302c4433fbba/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.729223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1521517be244e36887cd3e6c699a342, user_id=3aea42a7b62547f39cf3302c4433fbba, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:11.732599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:11.749184 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1157/2322] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:45:11 2022] PUT /identity/v3/projects/d1521517be244e36887cd3e6c699a342/users/3aea42a7b62547f39cf3302c4433fbba/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:45:11.816561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:11.816766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:11.817026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:11.844731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] MFA Rules not processed for user `3aea42a7b62547f39cf3302c4433fbba`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:11.846001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:11.910090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1166/2323] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:11 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:11.944964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:11.946875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:12.009822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12cc62-292f-47ec-8def-0976bf80dcc2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:12.013663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7594dc7-5b4f-4e2b-99d6-dfb414b9569c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:12.014426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594dc7-5b4f-4e2b-99d6-dfb414b9569c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:12.014712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594dc7-5b4f-4e2b-99d6-dfb414b9569c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:12.014992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594dc7-5b4f-4e2b-99d6-dfb414b9569c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:12.023640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7594dc7-5b4f-4e2b-99d6-dfb414b9569c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:12.025111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7594dc7-5b4f-4e2b-99d6-dfb414b9569c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:12.036156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1158/2324] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:11 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:12.054620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:12.117983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a892e-7d71-4253-abf3-a97463c5999e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:12.122665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:12.123312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:12.123599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:12.123888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] PATH_INFO: `/v3/users/3aea42a7b62547f39cf3302c4433fbba` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:12.125083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aea42a7b62547f39cf3302c4433fbba)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:12.127055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:12.152282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:12.186431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aea42a7b62547f39cf3302c4433fbba'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.193341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aea42a7b62547f39cf3302c4433fbba'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.194249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aea42a7b62547f39cf3302c4433fbba'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.194887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aea42a7b62547f39cf3302c4433fbba'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.207107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aea42a7b62547f39cf3302c4433fbba'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.222034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1167/2325] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:12 2022] DELETE /identity/v3/users/3aea42a7b62547f39cf3302c4433fbba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:45:12.226544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:12.227073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:12.227229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:12.249723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:12.251714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:12.340415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1159/2326] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:12.350966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:12.352450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:12.423878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0512-fb7b-4ee7-bf6d-770ae9f2427b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:12.428612 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144adee7-328e-4cab-a4aa-c0117baa3abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:12.429236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144adee7-328e-4cab-a4aa-c0117baa3abc service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:12.429520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144adee7-328e-4cab-a4aa-c0117baa3abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:12.429832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144adee7-328e-4cab-a4aa-c0117baa3abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:12.439672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144adee7-328e-4cab-a4aa-c0117baa3abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:12.441107 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144adee7-328e-4cab-a4aa-c0117baa3abc service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:12.451452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1168/2327] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:12.723634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:12.725103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:12.738474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb590e5-606a-4d7b-a7b6-64553e4d9a9f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:12.743048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:12.743690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:12.743973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:12.744250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] PATH_INFO: `/v3/projects/d1521517be244e36887cd3e6c699a342` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:12.745408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1521517be244e36887cd3e6c699a342)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:12.747400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:12.775373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:12.798983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1521517be244e36887cd3e6c699a342', 'request_id': 'req-13fafc49-1c5d-4564-88a7-3141f1f90131'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.805294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1521517be244e36887cd3e6c699a342', 'request_id': 'req-13fafc49-1c5d-4564-88a7-3141f1f90131'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.811106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1521517be244e36887cd3e6c699a342', 'request_id': 'req-13fafc49-1c5d-4564-88a7-3141f1f90131'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.824968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] The token cache is being invalidate because project d1521517be244e36887cd3e6c699a342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:12.825242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.825910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:12.827437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1160/2328] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:12 2022] DELETE /identity/v3/projects/d1521517be244e36887cd3e6c699a342 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:22.446651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=8,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:22.821457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:26.236529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:26.237069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:26.237069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:26.256290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:26.257487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:26.324224 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1169/2329] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:26.355702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:26.357242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:26.434091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fafc49-1c5d-4564-88a7-3141f1f90131 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:26.440365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef958cc0-d088-43d9-81bb-545f77becac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:26.440986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef958cc0-d088-43d9-81bb-545f77becac4 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:26.441273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef958cc0-d088-43d9-81bb-545f77becac4 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:26.441554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef958cc0-d088-43d9-81bb-545f77becac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:26.450354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef958cc0-d088-43d9-81bb-545f77becac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:26.452632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef958cc0-d088-43d9-81bb-545f77becac4 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:26.462207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1161/2330] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:29.495032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:29.496493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:29.508196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a22a19-e2b7-4d78-bfe1-a27a6a9ecd97 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:29.512694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:29.513316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:29.513617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:29.513912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] PATH_INFO: `/v3/users/ae638af5bc4948e9aae18242059f2896` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:29.515709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae638af5bc4948e9aae18242059f2896)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:29.518781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:29.567549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae638af5bc4948e9aae18242059f2896'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:29.574660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae638af5bc4948e9aae18242059f2896'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:29.575331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae638af5bc4948e9aae18242059f2896'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:29.575940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae638af5bc4948e9aae18242059f2896'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:29.588248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae638af5bc4948e9aae18242059f2896'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:29.601385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1170/2331] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:45:29 2022] DELETE /identity/v3/users/ae638af5bc4948e9aae18242059f2896 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:29.606127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:29.606597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:29.606705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:29.625078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:29.626300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:29.685086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1162/2332] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:29.694497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:29.695915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:29.753902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741383b6-36bb-4bc7-b973-af9604d67a1d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:29.757485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695a660-bed8-462a-b5ab-62f227056347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:29.758238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695a660-bed8-462a-b5ab-62f227056347 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:29.758520 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695a660-bed8-462a-b5ab-62f227056347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:29.758796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695a660-bed8-462a-b5ab-62f227056347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:29.768491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695a660-bed8-462a-b5ab-62f227056347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:29.770073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695a660-bed8-462a-b5ab-62f227056347 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:29.781253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1171/2333] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:45:30.064669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.066250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:30.079253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af747-14d1-449d-8eb2-e2433a8fc563 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.084493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.085194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.085506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.085819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] PATH_INFO: `/v3/projects/1a118e5b3d724cfda9309bafc2de39aa` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.087168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a118e5b3d724cfda9309bafc2de39aa)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.089107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.138543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a118e5b3d724cfda9309bafc2de39aa', 'request_id': 'req-aedaf597-5c2f-44ed-b972-ad13bb83472c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:30.145706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a118e5b3d724cfda9309bafc2de39aa', 'request_id': 'req-aedaf597-5c2f-44ed-b972-ad13bb83472c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:30.151430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a118e5b3d724cfda9309bafc2de39aa', 'request_id': 'req-aedaf597-5c2f-44ed-b972-ad13bb83472c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:30.163657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] The token cache is being invalidate because project 1a118e5b3d724cfda9309bafc2de39aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:45:30.163941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:30.164555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-aedaf597-5c2f-44ed-b972-ad13bb83472c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:45:30.166097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1163/2334] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:45:30 2022] DELETE /identity/v3/projects/1a118e5b3d724cfda9309bafc2de39aa => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:30.170947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.171290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.171567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.191569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:30.192758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:30.202269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:30.254212 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1172/2335] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:30.261977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.262263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.262536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.283402 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:30.284593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:30.292404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1164/2336] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:30.297018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.307549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ed0c-99d8-45f8-8f47-50f39e424bbf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.312620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.313257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.313541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.313855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.314550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:45:30.315487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.317345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.333980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1173/2337] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:45:30.335559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.340675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:30.347670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59dcf-54d6-40a3-9611-bb5dd8f39a50 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.353586 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.354083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.354367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.354650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.355315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.357262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.386803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1165/2338] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:45:30 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:30.392770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.414046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84c08-5e5d-4d9b-b7b2-0ab546d8d8e2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.490740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.491437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.491788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.492130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.492959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.494972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.522539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1174/2339] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:45:30 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:45:30.526688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.537077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3a94f-af46-48a8-84b8-b1d7f24eabad admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.542230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.543373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.543373 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.543805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.544734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.547031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.559021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1166/2340] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:30.569755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.580262 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c914c-cee4-4a4e-81e6-971acc341611 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.584956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d20e-c580-4f46-b356-dc0a330e3bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.585565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d20e-c580-4f46-b356-dc0a330e3bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.585882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d20e-c580-4f46-b356-dc0a330e3bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.586157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d20e-c580-4f46-b356-dc0a330e3bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.586849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0d20e-c580-4f46-b356-dc0a330e3bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.588449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0d20e-c580-4f46-b356-dc0a330e3bcb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.600088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1175/2341] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:45:30.604204 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.615256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5be15-4330-408b-a9c2-e3aba666ebe3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.624847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.626126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.626543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.626877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] PATH_INFO: `/v3/projects/e2f8bfc4a6c440729abf36d2329ff9bf/users/7f83e061b43345c895b7b3eb6c622f1b/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.646945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f8bfc4a6c440729abf36d2329ff9bf, user_id=7f83e061b43345c895b7b3eb6c622f1b, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.650176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.664213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1167/2342] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:45:30 2022] PUT /identity/v3/projects/e2f8bfc4a6c440729abf36d2329ff9bf/users/7f83e061b43345c895b7b3eb6c622f1b/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:45:30.675502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e2af-757f-4ec4-916c-836dbeb5d7fb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.675824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e2af-757f-4ec4-916c-836dbeb5d7fb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.676104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e2af-757f-4ec4-916c-836dbeb5d7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.714417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e815e2af-757f-4ec4-916c-836dbeb5d7fb None None] MFA Rules not processed for user `7f83e061b43345c895b7b3eb6c622f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:30.715780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e815e2af-757f-4ec4-916c-836dbeb5d7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:30.796554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1176/2343] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:30.808714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:30.810623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:30.879219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488351b-2d10-4ee1-9383-bfca6f599820 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:30.883416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:30.884242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:30.884381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:30.884595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:30.894294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:30.895790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:30.906857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1168/2344] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:31.666284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724527-7cbc-406a-b120-967295638f08 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:31.666284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724527-7cbc-406a-b120-967295638f08 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:31.666864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724527-7cbc-406a-b120-967295638f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:31.697507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-24724527-7cbc-406a-b120-967295638f08 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:31.700931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24724527-7cbc-406a-b120-967295638f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:31.706572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:31.790141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1177/2345] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:31.814262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:31.816407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:31.921532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abfc58-ef1d-48aa-af88-9097cca055b9 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:31.930546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818280d3-09f6-4365-ac00-6f73bfcd4419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:31.932177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818280d3-09f6-4365-ac00-6f73bfcd4419 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:31.932666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818280d3-09f6-4365-ac00-6f73bfcd4419 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:31.933143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818280d3-09f6-4365-ac00-6f73bfcd4419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:31.944078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818280d3-09f6-4365-ac00-6f73bfcd4419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:31.946620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818280d3-09f6-4365-ac00-6f73bfcd4419 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:31.960351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1169/2346] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:32.053726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c809-ce7c-4863-aab0-644bf4ed8976 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:32.054383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c809-ce7c-4863-aab0-644bf4ed8976 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:32.054936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c809-ce7c-4863-aab0-644bf4ed8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:32.089379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-74f4c809-ce7c-4863-aab0-644bf4ed8976 None None] MFA Rules not processed for user `b2e41aeff8cd43a1ae221b6cbfce2dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:32.091172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-74f4c809-ce7c-4863-aab0-644bf4ed8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:32.165752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1178/2347] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:45:32.451507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:32.451935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:32.452323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:32.478426 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] MFA Rules not processed for user `7f83e061b43345c895b7b3eb6c622f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:32.479803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:32.489992 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1170/2348] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:35.797669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a6d8-519b-4d3a-8937-bc4fdec29073 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:35.798192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a6d8-519b-4d3a-8937-bc4fdec29073 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:35.798285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8a6d8-519b-4d3a-8937-bc4fdec29073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:35.817381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e5c8a6d8-519b-4d3a-8937-bc4fdec29073 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:35.818630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e5c8a6d8-519b-4d3a-8937-bc4fdec29073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:35.827772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1179/2349] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:35.852988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:35.865995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e15fe3-26a0-431b-9c1f-74d0dc76310c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:35.871569 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:35.872175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:35.872466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:35.872744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:35.881540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:35.883157 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:35.893361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1171/2350] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:42.034668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:42.036341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:42.036840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:42.062329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:42.064125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:42.072411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1180/2351] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:42.095746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:42.107062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab985ea-40a7-4b79-9392-d8da35dc6bda service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:42.112758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45812e6d-df5e-4c9c-b388-75587694f8e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:42.113470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812e6d-df5e-4c9c-b388-75587694f8e1 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:42.113823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812e6d-df5e-4c9c-b388-75587694f8e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:42.114102 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812e6d-df5e-4c9c-b388-75587694f8e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:42.122513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45812e6d-df5e-4c9c-b388-75587694f8e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:42.124573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45812e6d-df5e-4c9c-b388-75587694f8e1 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:42.129562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:42.137672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1172/2352] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:47.101683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:47.103219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:47.164849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047bc7b-871a-4bf0-9551-2bd83f22f3a0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:47.168614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:47.169312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:47.169704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:47.170050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:47.172426 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:47.232675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:47.237783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:47.239211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:47.248916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1181/2353] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:48.269857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607aead-af64-41e5-81bb-a455fb79b15f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:48.270927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607aead-af64-41e5-81bb-a455fb79b15f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:48.271413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607aead-af64-41e5-81bb-a455fb79b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:48.292473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4607aead-af64-41e5-81bb-a455fb79b15f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:48.294014 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4607aead-af64-41e5-81bb-a455fb79b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:48.302809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1173/2354] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:48.334562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:48.352669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7631806-8adf-4001-8ed2-49ba60d41ddb service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:48.362273 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:48.364097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:48.364578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:48.364991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:48.378742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:48.380625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:48.393684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1182/2355] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:45:53.476742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:53.477295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:53.477295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:53.497864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:45:53.499071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:45:53.507130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1174/2356] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:45:53.527623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:45:53.539069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe77940-5c88-461b-88c1-dd478bf3ccc6 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:45:53.544526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:45:53.545124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:45:53.545429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:45:53.545725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:45:53.555437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:45:53.557004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:45:53.567384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1183/2357] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:03.492607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:03.562888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=15 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:14.643131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:14.645524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:14.694944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:14.696684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:14.762273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c2d0-4e58-4845-a25f-09e248428c45 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:14.777441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:14.778598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:14.779163 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:14.779884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:14.783854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:14.801870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:14.803898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf445c-2f28-4623-bd43-c92cb9a7b822 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:14.805201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7519e5-04bf-4a3f-952d-f58fe362ea9c service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:14.811905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:14.812844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:14.813276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:14.814647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:14.819613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1175/2358] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:46:14.825279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:14.828141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:14.846331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1184/2359] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:17.333945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d5a7a-49fa-4c2a-92c2-714dc67c69f9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:17.334403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d5a7a-49fa-4c2a-92c2-714dc67c69f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:17.334552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d5a7a-49fa-4c2a-92c2-714dc67c69f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:17.353841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bc1d5a7a-49fa-4c2a-92c2-714dc67c69f9 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:17.355038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bc1d5a7a-49fa-4c2a-92c2-714dc67c69f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:17.408080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1176/2360] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:17.456494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:17.458029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:17.549844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93540-3b4d-4087-bf9a-86aa53aae5f0 service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:17.557921 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:17.558624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:17.558911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:17.559216 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:17.571569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:17.573711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:17.589441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1185/2361] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:18.124002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33a75-32e2-4fbd-968a-b2ab5001beca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:18.124294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33a75-32e2-4fbd-968a-b2ab5001beca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:18.124603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33a75-32e2-4fbd-968a-b2ab5001beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:18.146082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-34b33a75-32e2-4fbd-968a-b2ab5001beca None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:18.147297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-34b33a75-32e2-4fbd-968a-b2ab5001beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:18.155460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1177/2362] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 29 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:18.170820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:18.181756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6275-1f9f-4fd4-bfc0-92f34aedf17b service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:18.186863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:18.187688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:18.187973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:18.188252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:18.197062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:18.198762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:18.208202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1186/2363] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:18.482909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159bd91-5f0c-4627-b3e4-5cb0b3c493d0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:18.483338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159bd91-5f0c-4627-b3e4-5cb0b3c493d0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:18.483584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159bd91-5f0c-4627-b3e4-5cb0b3c493d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:18.503095 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c159bd91-5f0c-4627-b3e4-5cb0b3c493d0 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:18.504349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c159bd91-5f0c-4627-b3e4-5cb0b3c493d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:18.511713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1178/2364] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:18.525058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:18.535722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5953ca-a3c6-4b4f-8609-ea91319e95c8 service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:18.540768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:18.541393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:18.541699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:18.541977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:18.550316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:18.551891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:18.560417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1187/2365] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:18.937641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb5277-48a3-451f-945f-a48b8a5da44a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:18.938547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb5277-48a3-451f-945f-a48b8a5da44a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:18.938994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb5277-48a3-451f-945f-a48b8a5da44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:18.959508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-61bb5277-48a3-451f-945f-a48b8a5da44a None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:18.960827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-61bb5277-48a3-451f-945f-a48b8a5da44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:18.970017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1179/2366] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 29 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:18.986536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:18.999597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886dde1-5255-421d-98b3-7f701690807b service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:19.006010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c6f16-49d8-47d8-b493-83502079a099 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:19.006806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6f16-49d8-47d8-b493-83502079a099 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:19.007236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6f16-49d8-47d8-b493-83502079a099 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:19.007701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6f16-49d8-47d8-b493-83502079a099 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:19.016770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c6f16-49d8-47d8-b493-83502079a099 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:19.018442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c6f16-49d8-47d8-b493-83502079a099 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:19.033959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1188/2367] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:19.872354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:19.872870 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:19.872974 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:19.921374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] MFA Rules not processed for user `8990ee8f728f4dea9686b4819ee28fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:19.923219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:20.032091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1180/2368] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:20.690062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7b892-9d6e-4163-978b-5fa72b600ca7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:20.691261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7b892-9d6e-4163-978b-5fa72b600ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:20.691536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7b892-9d6e-4163-978b-5fa72b600ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:20.713059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bcd7b892-9d6e-4163-978b-5fa72b600ca7 None None] MFA Rules not processed for user `19681d65ded445c2aed343a5601f8e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:20.714318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bcd7b892-9d6e-4163-978b-5fa72b600ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:20.757052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:20.783604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1189/2369] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:21.324779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:21.336284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321914-188b-404f-a2ba-8db8e7b64299 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:21.340876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:21.341507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:21.341938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:21.342218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] PATH_INFO: `/v3/users/7f83e061b43345c895b7b3eb6c622f1b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:21.343371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f83e061b43345c895b7b3eb6c622f1b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:21.345380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:21.359795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:21.394954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f83e061b43345c895b7b3eb6c622f1b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:21.402318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f83e061b43345c895b7b3eb6c622f1b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:21.403035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f83e061b43345c895b7b3eb6c622f1b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:21.403641 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f83e061b43345c895b7b3eb6c622f1b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:21.416425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f83e061b43345c895b7b3eb6c622f1b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:21.430008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1181/2370] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:46:21 2022] DELETE /identity/v3/users/7f83e061b43345c895b7b3eb6c622f1b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:46:21.434559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:21.434853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:21.435134 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:21.456089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:21.457314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:21.519137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1190/2371] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:21.528591 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:21.530134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:21.589405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24f534-94e6-465e-a56a-bab5f19ca60e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:21.593239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19bdb-d6e0-4401-83a7-3a49126f8434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:21.593893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19bdb-d6e0-4401-83a7-3a49126f8434 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:21.594313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19bdb-d6e0-4401-83a7-3a49126f8434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:21.594661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19bdb-d6e0-4401-83a7-3a49126f8434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:21.604281 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19bdb-d6e0-4401-83a7-3a49126f8434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:21.605751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19bdb-d6e0-4401-83a7-3a49126f8434 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:21.616807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1182/2372] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:21.982625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:21.984151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:21.998672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450b54-d6d2-4e3c-a797-1fb9bff02637 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.005983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.022538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.023640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.024528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] PATH_INFO: `/v3/projects/e2f8bfc4a6c440729abf36d2329ff9bf` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.029785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f8bfc4a6c440729abf36d2329ff9bf)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.032044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.095499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f8bfc4a6c440729abf36d2329ff9bf', 'request_id': 'req-f2c89c84-1e33-4b51-97b6-dbf783be6abb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:22.102417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f8bfc4a6c440729abf36d2329ff9bf', 'request_id': 'req-f2c89c84-1e33-4b51-97b6-dbf783be6abb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:22.108987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f8bfc4a6c440729abf36d2329ff9bf', 'request_id': 'req-f2c89c84-1e33-4b51-97b6-dbf783be6abb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:22.121961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] The token cache is being invalidate because project e2f8bfc4a6c440729abf36d2329ff9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:46:22.122253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:22.122883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f2c89c84-1e33-4b51-97b6-dbf783be6abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:46:22.128002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1191/2373] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:46:21 2022] DELETE /identity/v3/projects/e2f8bfc4a6c440729abf36d2329ff9bf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:46:22.129400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.129728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.130012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.150278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:22.151511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:22.211170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1183/2374] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:22.219610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.219911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.220180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.240083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:22.241289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:22.249209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1192/2375] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:22.253349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.263978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92db0e-531f-4592-8f40-f509ac9f011b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.268887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.269503 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.269821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.270097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.270798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:46:22.271115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.272720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.293248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1184/2376] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:46:22.293940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.305202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224111-59ef-493f-8b86-6aca8dbcb969 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.310285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.311029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.311403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.311913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.312831 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.315008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.346232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1193/2377] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:46:22 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:46:22.350784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.363894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ee54d-eab0-4a86-960d-2a451bdee326 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.384309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:22.438681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.439321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.439606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.440115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.440809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.442884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.469962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1185/2378] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:46:22 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:46:22.474467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.486497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4115-bb5b-4c7c-8e9e-35c46dcedbb6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.491341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.491958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.492256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.492521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.493246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.494889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.506906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1194/2379] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:46:22.511121 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.523879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9fc0-8cd2-4026-9a3f-319e0fdab56e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.528899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d92e22-2cd1-4253-a2c2-664a6a10e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.529663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92e22-2cd1-4253-a2c2-664a6a10e77f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.530171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92e22-2cd1-4253-a2c2-664a6a10e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.530635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92e22-2cd1-4253-a2c2-664a6a10e77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.531745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d92e22-2cd1-4253-a2c2-664a6a10e77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.533876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d92e22-2cd1-4253-a2c2-664a6a10e77f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.552628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.558029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1186/2380] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:46:22.567615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283024db-cebe-4c24-afeb-e7917d4f8882 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.572497 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.573195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.573474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.573789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] PATH_INFO: `/v3/projects/f708a9d1759441d98c73f96ab58559fe/users/d6c206952a7b4543884455fa748cbf77/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.594933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f708a9d1759441d98c73f96ab58559fe, user_id=d6c206952a7b4543884455fa748cbf77, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.599259 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.613208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1195/2381] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:46:22 2022] PUT /identity/v3/projects/f708a9d1759441d98c73f96ab58559fe/users/d6c206952a7b4543884455fa748cbf77/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:46:22.618800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de341a1-2976-4185-a786-5fd86a9dfb08 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.619082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de341a1-2976-4185-a786-5fd86a9dfb08 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.619358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de341a1-2976-4185-a786-5fd86a9dfb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.639622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4de341a1-2976-4185-a786-5fd86a9dfb08 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:22.640833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4de341a1-2976-4185-a786-5fd86a9dfb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:22.707013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1187/2382] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:22.716513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:22.719333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:22.727834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:22.790905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7481-49e0-48e8-a29d-337343deeecc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:22.794651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:22.795442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:22.795728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:22.796005 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:22.806958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:22.808409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:22.818811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1196/2383] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:28.466343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.467874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.468703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.509846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] MFA Rules not processed for user `d6c206952a7b4543884455fa748cbf77`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:28.511087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:28.587970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1188/2384] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:28.594518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:28.604785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e00b3-a7ca-468c-b0a3-0eedf00889ca service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:28.609484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:28.610129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.610413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.610690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.611366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:28.613263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:28.641585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1197/2385] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:46:28 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:46:28.645670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:28.656859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346429-ae95-4860-b6d1-a18382cddf33 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:28.685445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:28.714584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:28.715194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.715473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.715746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.716415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:28.718879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:28.739513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1189/2386] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:46:28 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:46:28.743450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:28.754097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ba85-ef81-4ecc-bb9b-5a9f9606aa68 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:28.758604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945bba7-b229-433b-8116-892244754522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:28.759202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945bba7-b229-433b-8116-892244754522 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.759483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945bba7-b229-433b-8116-892244754522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.759754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945bba7-b229-433b-8116-892244754522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.760435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945bba7-b229-433b-8116-892244754522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:28.762091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945bba7-b229-433b-8116-892244754522 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:28.772912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1198/2387] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:46:28.776852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:28.788331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18cbb8-2cba-494a-83ee-1b83fd077fb0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:28.793209 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:28.794057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.794411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.794783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] PATH_INFO: `/v3/projects/6d8feb42f01d4d278356ec1794da4056/users/f8d2b64bb8c0461b9fecc1c0b4e46b63/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.813122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8feb42f01d4d278356ec1794da4056, user_id=f8d2b64bb8c0461b9fecc1c0b4e46b63, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:28.815817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:28.830942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1190/2388] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:46:28 2022] PUT /identity/v3/projects/6d8feb42f01d4d278356ec1794da4056/users/f8d2b64bb8c0461b9fecc1c0b4e46b63/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:46:28.834751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945bba7-b229-433b-8116-892244754522 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:28.845080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945bba7-b229-433b-8116-892244754522 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:28.908666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fc57c-d315-4c06-841a-a787f24c2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:28.909284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fc57c-d315-4c06-841a-a787f24c2368 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.909565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fc57c-d315-4c06-841a-a787f24c2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.909868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fc57c-d315-4c06-841a-a787f24c2368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.910560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fc57c-d315-4c06-841a-a787f24c2368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:28.912177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fc57c-d315-4c06-841a-a787f24c2368 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:28.922018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1199/2389] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:46:28.926117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:28.937459 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907a960-9b77-48fb-a2ea-39df7de0568c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:28.942326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:28.942994 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:28.943280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:28.943593 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] PATH_INFO: `/v3/projects/6d8feb42f01d4d278356ec1794da4056/users/f8d2b64bb8c0461b9fecc1c0b4e46b63/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:28.945560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8feb42f01d4d278356ec1794da4056, user_id=f8d2b64bb8c0461b9fecc1c0b4e46b63, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:28.948258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:28.959663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1191/2390] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:46:28 2022] PUT /identity/v3/projects/6d8feb42f01d4d278356ec1794da4056/users/f8d2b64bb8c0461b9fecc1c0b4e46b63/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:46:31.471718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2eaee-29e0-4523-bd86-6eef30fc8e5b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:31.472418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2eaee-29e0-4523-bd86-6eef30fc8e5b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:31.472917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2eaee-29e0-4523-bd86-6eef30fc8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:31.497787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-d4c2eaee-29e0-4523-bd86-6eef30fc8e5b None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:31.499606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d4c2eaee-29e0-4523-bd86-6eef30fc8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:31.587871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1200/2391] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:31.605006 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:31.610826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:31.781331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa672f9-d547-40cb-aedb-89c614bec99c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:31.789988 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:31.790705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:31.791055 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:31.791418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:31.802761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:31.804899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:31.840609 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1192/2392] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:36.710710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5f03d-68ed-4356-a624-6b9510673249 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:36.711336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5f03d-68ed-4356-a624-6b9510673249 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:36.712922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5f03d-68ed-4356-a624-6b9510673249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:36.778530 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-78f5f03d-68ed-4356-a624-6b9510673249 None None] MFA Rules not processed for user `f8d2b64bb8c0461b9fecc1c0b4e46b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:36.780346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-78f5f03d-68ed-4356-a624-6b9510673249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:36.802840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:36.893972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1201/2393] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:36.905855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:36.907371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:37.046973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0cf4-965c-403d-a7c6-ea88c179033c service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:37.052608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:37.054395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:37.054395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:37.054395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:37.065742 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:37.124777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:37.126177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:37.135532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1193/2394] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:37.281357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee06e7-6e95-42ad-a2cf-8672ff47428f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:37.281674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee06e7-6e95-42ad-a2cf-8672ff47428f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:37.281960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee06e7-6e95-42ad-a2cf-8672ff47428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:37.307667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-b3ee06e7-6e95-42ad-a2cf-8672ff47428f None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:37.308991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b3ee06e7-6e95-42ad-a2cf-8672ff47428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:37.318660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1202/2395] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:37.339471 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:37.363081 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd9004-f399-471f-b587-c5b52cb6bd56 service glance] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:37.368723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0c0a1-0280-4263-914d-de53cac98112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:37.369361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0c0a1-0280-4263-914d-de53cac98112 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:37.370971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0c0a1-0280-4263-914d-de53cac98112 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:37.371278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0c0a1-0280-4263-914d-de53cac98112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:37.383927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0c0a1-0280-4263-914d-de53cac98112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:37.385774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0c0a1-0280-4263-914d-de53cac98112 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:37.399404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1194/2396] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:47.300385 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=30 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:47.391959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=30 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:46:50.071815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b561a-545a-45e0-b159-715273850a2f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:50.072372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b561a-545a-45e0-b159-715273850a2f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:50.072545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b561a-545a-45e0-b159-715273850a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:50.091592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-537b561a-545a-45e0-b159-715273850a2f None None] MFA Rules not processed for user `d6c206952a7b4543884455fa748cbf77`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:50.092793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-537b561a-545a-45e0-b159-715273850a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:50.099999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1203/2397] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:46:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:50.101460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3b33-f397-4f5f-8fd9-35bdbb90b346 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:50.101972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3b33-f397-4f5f-8fd9-35bdbb90b346 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:50.102089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3b33-f397-4f5f-8fd9-35bdbb90b346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:50.123224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-728c3b33-f397-4f5f-8fd9-35bdbb90b346 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:50.124511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-728c3b33-f397-4f5f-8fd9-35bdbb90b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:50.186162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1195/2398] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:50.228098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b561a-545a-45e0-b159-715273850a2f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:50.229495 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-537b561a-545a-45e0-b159-715273850a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:50.305708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b561a-545a-45e0-b159-715273850a2f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:50.311405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e319-61be-445e-b797-f3c7a3839033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:50.312065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e319-61be-445e-b797-f3c7a3839033 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:50.312355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e319-61be-445e-b797-f3c7a3839033 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:50.312651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e319-61be-445e-b797-f3c7a3839033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:50.321168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75e319-61be-445e-b797-f3c7a3839033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:50.322777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75e319-61be-445e-b797-f3c7a3839033 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:50.332675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1204/2399] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:53.519479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42668-8b42-4144-aff2-8584a02f8af1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.519950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42668-8b42-4144-aff2-8584a02f8af1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.520431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42668-8b42-4144-aff2-8584a02f8af1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.522171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1196/2400] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:46:53.528791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd6220-2283-4d81-9774-42b00f5f5af2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.529231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd6220-2283-4d81-9774-42b00f5f5af2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.529357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd6220-2283-4d81-9774-42b00f5f5af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.550017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5bdd6220-2283-4d81-9774-42b00f5f5af2 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:53.551379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5bdd6220-2283-4d81-9774-42b00f5f5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:53.562067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1205/2401] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:46:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:53.576873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42668-8b42-4144-aff2-8584a02f8af1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:53.578606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10c42668-8b42-4144-aff2-8584a02f8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:53.592040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42668-8b42-4144-aff2-8584a02f8af1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:53.595528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33774-0492-4da0-8a5d-47403fe072f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:53.596134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33774-0492-4da0-8a5d-47403fe072f1 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.596419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33774-0492-4da0-8a5d-47403fe072f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.596697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33774-0492-4da0-8a5d-47403fe072f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.607915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33774-0492-4da0-8a5d-47403fe072f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:53.609341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33774-0492-4da0-8a5d-47403fe072f1 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:53.620629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1197/2402] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:53.701415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21e30-be55-4313-854b-cdbc957fafc3 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.701736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21e30-be55-4313-854b-cdbc957fafc3 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.702031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21e30-be55-4313-854b-cdbc957fafc3 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.703402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1206/2403] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:46:53.708481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c6b0-f477-4be2-8772-d49a3458ef2f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.708787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c6b0-f477-4be2-8772-d49a3458ef2f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.709061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c6b0-f477-4be2-8772-d49a3458ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.730458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-05f1c6b0-f477-4be2-8772-d49a3458ef2f None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:53.732251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-05f1c6b0-f477-4be2-8772-d49a3458ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:53.789967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1198/2404] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:46:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:46:53.802382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21e30-be55-4313-854b-cdbc957fafc3 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:53.804069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-48e21e30-be55-4313-854b-cdbc957fafc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:53.817796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21e30-be55-4313-854b-cdbc957fafc3 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:53.821292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc994027-9980-44fe-b78b-1954de3ab8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:53.821960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc994027-9980-44fe-b78b-1954de3ab8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.822222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc994027-9980-44fe-b78b-1954de3ab8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.822500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc994027-9980-44fe-b78b-1954de3ab8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.829488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc994027-9980-44fe-b78b-1954de3ab8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:53.830948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc994027-9980-44fe-b78b-1954de3ab8e2 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:53.838621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1207/2405] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:53.921240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec2f8-e005-4bd6-849d-02a06acf4f91 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.921563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec2f8-e005-4bd6-849d-02a06acf4f91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.921873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec2f8-e005-4bd6-849d-02a06acf4f91 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.923279 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1199/2406] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:46:53.929714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe741b2-f894-44c9-91f5-31898b258deb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.930006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe741b2-f894-44c9-91f5-31898b258deb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.930296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe741b2-f894-44c9-91f5-31898b258deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:53.951599 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-bfe741b2-f894-44c9-91f5-31898b258deb None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:53.952889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bfe741b2-f894-44c9-91f5-31898b258deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:53.962351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1208/2407] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:46:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:53.972791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec2f8-e005-4bd6-849d-02a06acf4f91 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:53.984185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec2f8-e005-4bd6-849d-02a06acf4f91 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:53.988045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:53.988690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:53.988973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:53.989253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:54.000878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:54.002367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:54.013884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1200/2408] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:46:55.051306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5f89-baab-4e38-9471-642243a5e8ba None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:55.051740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5f89-baab-4e38-9471-642243a5e8ba None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:55.051740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5f89-baab-4e38-9471-642243a5e8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:55.092415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-0cbf5f89-baab-4e38-9471-642243a5e8ba None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:55.094037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0cbf5f89-baab-4e38-9471-642243a5e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:55.104335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1209/2409] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:46:55.119520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:55.132076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0701c17-b8a9-40fb-b7e9-47a312e89282 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:55.137047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:55.138313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:55.138600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:55.138876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:55.148946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:55.151706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:55.166745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1201/2410] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:46:55.636688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666a2ce-9f19-4483-9b0f-d9d70f524130 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:55.637383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666a2ce-9f19-4483-9b0f-d9d70f524130 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:55.637867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666a2ce-9f19-4483-9b0f-d9d70f524130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:55.676161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-5666a2ce-9f19-4483-9b0f-d9d70f524130 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:46:55.684415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5666a2ce-9f19-4483-9b0f-d9d70f524130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:55.694133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1210/2411] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:46:55.718954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:46:55.720406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:46:55.743262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220f84-9418-43ea-83be-0e8decc15f55 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:46:55.750092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:46:55.751059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:46:55.751539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:46:55.751996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:46:55.763206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:46:55.765135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:46:55.794183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1202/2412] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:47:05.663890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=55 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:05.788687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=74 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:18.218135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc1481-d5d9-418d-b37c-cac67ee331ab None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:18.218636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc1481-d5d9-418d-b37c-cac67ee331ab None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:18.218636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc1481-d5d9-418d-b37c-cac67ee331ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:18.237470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c0cc1481-d5d9-418d-b37c-cac67ee331ab None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:47:18.238756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c0cc1481-d5d9-418d-b37c-cac67ee331ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:47:18.246982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1211/2413] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:47:18.272603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:47:18.288722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4425c2f-cf9f-4371-9950-1e61e79c94cf service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:47:18.295004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:47:18.295643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:18.295927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:18.296205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:18.305326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:47:18.306952 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:47:18.317105 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1203/2414] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:47:21.853980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97219a56-96d7-4eb9-bf82-9ba0b6e98f4c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:21.854462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97219a56-96d7-4eb9-bf82-9ba0b6e98f4c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:21.854584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97219a56-96d7-4eb9-bf82-9ba0b6e98f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:21.874546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-97219a56-96d7-4eb9-bf82-9ba0b6e98f4c None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:47:21.875744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-97219a56-96d7-4eb9-bf82-9ba0b6e98f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:47:21.882856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1212/2415] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:47:21.904599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:47:21.915975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b5ad-3e23-4f86-b461-05f28ec5ed27 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:47:21.920967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:47:21.921566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:21.921890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:21.922168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:21.930541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:47:21.932124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:47:21.941040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1204/2416] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:47:31.868704 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=6 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:31.937653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=12 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:38.897009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf08948-9ccc-47ca-933f-11f8b358d95c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:38.897643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf08948-9ccc-47ca-933f-11f8b358d95c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:38.897643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf08948-9ccc-47ca-933f-11f8b358d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:38.917510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-caf08948-9ccc-47ca-933f-11f8b358d95c None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:47:38.918755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-caf08948-9ccc-47ca-933f-11f8b358d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:47:38.926893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1213/2417] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:47:38.958003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:47:38.970474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77a72b-90b3-47f6-95cf-3d2dad18b2fd service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:47:38.981779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:47:38.982391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:38.982670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:38.983053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:38.991748 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:47:38.993397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:47:39.003278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1205/2418] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:47:46.199289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec4fa-de38-4e19-a094-aba578a24879 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:46.199779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec4fa-de38-4e19-a094-aba578a24879 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:46.199875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ec4fa-de38-4e19-a094-aba578a24879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:46.219619 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-485ec4fa-de38-4e19-a094-aba578a24879 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:47:46.220802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-485ec4fa-de38-4e19-a094-aba578a24879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:47:46.230326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1214/2419] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Jul 29 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:47:46.252228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:47:46.265451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6740a-ad83-43d6-84b0-3af21bfc2dbd service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:47:46.272260 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:47:46.272982 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:46.273749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:46.273749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:46.283531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:47:46.285124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:47:46.296510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1206/2420] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:47:50.624180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:50.624700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:50.624790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:50.647352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:47:50.648563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:47:50.656848 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1215/2421] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 29 04:47:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:47:50.675543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:47:50.694257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b91634-07af-4fb7-8b13-f5821e5aa825 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:47:50.702045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:47:50.703143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:50.703657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:50.704137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:50.718115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:47:50.720465 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:47:50.730481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1207/2422] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:47:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:47:54.775278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:47:54.785243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdeb3c-9b79-49c5-beb4-02d5c5d8a6ce None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:47:54.788787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:47:54.789525 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:47:54.789849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:47:54.790126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:47:54.799073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:47:54.800776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:47:54.810453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1216/2423] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:47:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:00.726402 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=18 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:04.806218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=15 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:14.317935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:14.327440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a07680-e041-443f-8cbf-7ef3473ca949 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:14.331013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:14.331619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:14.331939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:14.332216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:14.334162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:14.347896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:14.349403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc76ae-78bb-4f5d-b79e-b637376dd6e8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:14.360979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1208/2424] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:15.546114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:15.555155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433932e3-4e16-49be-a574-391eb75fb936 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:15.558832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:15.559588 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:15.559707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:15.560060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:15.561970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:15.577376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:15.578896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:15.590804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1217/2425] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:20.410115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:20.410643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:20.410759 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:20.429319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] MFA Rules not processed for user `b2e41aeff8cd43a1ae221b6cbfce2dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:48:20.430554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:20.484939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1209/2426] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:48:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:48:22.728442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:22.730023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:22.745648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d51de-8211-4099-967c-4cb3c74eae60 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:22.750238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:22.750876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:22.751160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:22.751437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] PATH_INFO: `/v3/users/19681d65ded445c2aed343a5601f8e4f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:22.752646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19681d65ded445c2aed343a5601f8e4f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:22.754585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:22.931172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19681d65ded445c2aed343a5601f8e4f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:22.940882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19681d65ded445c2aed343a5601f8e4f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:22.943510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19681d65ded445c2aed343a5601f8e4f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:22.943510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19681d65ded445c2aed343a5601f8e4f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:22.955382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19681d65ded445c2aed343a5601f8e4f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:22.968644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1218/2427] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:48:22 2022] DELETE /identity/v3/users/19681d65ded445c2aed343a5601f8e4f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:48:23.142728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:23.154927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd693dc3-a77f-4204-9979-e1928ce05988 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:23.211154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:23.211946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:23.212869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:23.213147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] PATH_INFO: `/v3/projects/e9f9e88bcc904a109439dcd10c5438dc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:23.214497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f9e88bcc904a109439dcd10c5438dc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:23.216602 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:23.265143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f9e88bcc904a109439dcd10c5438dc', 'request_id': 'req-c3265062-89aa-4387-a48f-8369d919d28c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:23.271445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f9e88bcc904a109439dcd10c5438dc', 'request_id': 'req-c3265062-89aa-4387-a48f-8369d919d28c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:23.278451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f9e88bcc904a109439dcd10c5438dc', 'request_id': 'req-c3265062-89aa-4387-a48f-8369d919d28c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:23.290878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] The token cache is being invalidate because project e9f9e88bcc904a109439dcd10c5438dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:48:23.291174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:23.291816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3265062-89aa-4387-a48f-8369d919d28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:48:23.293413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1210/2428] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:48:23 2022] DELETE /identity/v3/projects/e9f9e88bcc904a109439dcd10c5438dc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:48:29.350925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:29.353769 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:29.450769 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37addbf-79a3-43b6-b71f-0dea69d7c1f7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:29.530823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:29.552659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:29.553289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:29.553574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:29.553881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:29.556433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:29.632492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:29.635175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:29.648560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1219/2429] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:33.287612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:37.635948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770951cb-b236-49be-9e39-686289c24e08 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:37.636612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770951cb-b236-49be-9e39-686289c24e08 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:37.636612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770951cb-b236-49be-9e39-686289c24e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:37.655385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-770951cb-b236-49be-9e39-686289c24e08 None None] MFA Rules not processed for user `8990ee8f728f4dea9686b4819ee28fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:48:37.656598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-770951cb-b236-49be-9e39-686289c24e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:37.663800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1211/2430] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:48:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:48:37.965028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:37.966564 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:38.021027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65986469-1f5b-4cbe-912d-2a0a28954ba2 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:38.024596 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:38.025202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:38.025485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:38.025789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:38.027487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:38.036561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:38.037937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:38.046429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1220/2431] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:38.369979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770951cb-b236-49be-9e39-686289c24e08 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:38.371417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-770951cb-b236-49be-9e39-686289c24e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:38.441791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770951cb-b236-49be-9e39-686289c24e08 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:38.446750 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:38.447364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:38.447647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:38.447923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:38.449698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:38.460808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:38.462899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:38.472556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1212/2432] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:44.542876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:44.544410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:44.554854 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9a0b-0881-4630-b3e2-8c7593c941cf service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:44.558933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:44.559648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:44.559929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:44.560205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:44.561924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:44.571604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:44.573007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:44.580806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1221/2433] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:48.468493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=35 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:52.384144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:52.386033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:52.404049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536acf6-c640-41d3-9204-50eafa181794 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:52.411409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:52.412390 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:52.412873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:52.413359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:52.416333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:52.431207 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:52.433751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:52.449879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1213/2434] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:48:54.577251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=62 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:59.156595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:48:59.157996 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:59.174446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb030-e832-4ad8-9f5a-bb275adde6e5 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:48:59.180779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:48:59.181384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:48:59.181710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:48:59.181991 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:48:59.183743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:48:59.241102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:48:59.243451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:48:59.253836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1222/2435] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:48:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:49:02.440303 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:03.848783 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:49:03.862381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed8100-9985-4c1b-8167-b722c49f0d7e service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:49:03.868418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:49:03.869027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:49:03.869306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:49:03.869587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:49:03.871339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:49:03.884334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:49:03.886109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda0fe2-274c-4ab1-b23f-c06be97b0987 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:49:03.897310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1214/2436] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:49:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:49:06.237158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:49:06.250420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b29ad-0b53-4b60-aefd-133cce63ca7a service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:49:06.256029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:49:06.257129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:49:06.257434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:49:06.258738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:49:06.261137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:49:06.275562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:49:06.277153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:49:06.288054 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1223/2437] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:49:09.491910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:49:09.492973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:49:09.493068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:49:09.512633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] MFA Rules not processed for user `3cf68e097d3941218efae9a5ef5bba12`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:49:09.513996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:49:09.520993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1215/2438] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:49:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:49:09.818542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:49:09.827841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09530-16f3-40c3-9072-6df770ab592b service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:49:09.831421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:49:09.832024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:49:09.832313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:49:09.832594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:49:09.834345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:49:09.844278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:49:09.845720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:49:09.854173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1224/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:49:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:49:19.508046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=9 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:19.850030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=40 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:42.824485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:49:42.825936 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:49:42.882707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0543-22e5-4899-8a66-8aa79ba0a1be None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:49:42.886324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:49:42.886934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:49:42.887220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:49:42.887498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:49:42.889240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:49:42.948398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:49:42.949868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:49:42.959127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1216/2440] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:49:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:49:52.954717 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=48 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:01.627380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:01.636698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c562e-3008-4f5e-b784-b277e2a321eb service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:01.640209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:01.640805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:01.641085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:01.641356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:01.643130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:01.704349 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:01.705783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:01.716094 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1225/2441] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:04.769837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:04.784001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f73590-5d87-404c-8a76-c9c1d5f12460 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:04.792948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:04.793819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:04.794211 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:04.794590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:04.796648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:04.811473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:04.813132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:04.827928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1217/2442] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:04.840860 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:04.843041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:04.858221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c073e-456e-4ea8-bb3c-277f6c22d63b service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:04.862967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:04.863611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:04.863889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:04.864197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] PATH_INFO: `/v3/users/b2e41aeff8cd43a1ae221b6cbfce2dab` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:04.865413 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e41aeff8cd43a1ae221b6cbfce2dab)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:04.867825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:04.914147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e41aeff8cd43a1ae221b6cbfce2dab'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:04.921015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e41aeff8cd43a1ae221b6cbfce2dab'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:04.921708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e41aeff8cd43a1ae221b6cbfce2dab'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:04.922313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e41aeff8cd43a1ae221b6cbfce2dab'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:04.934888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b6952d6c-8b93-48e2-ab8d-fa9eeae62be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e41aeff8cd43a1ae221b6cbfce2dab'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:04.948602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1226/2443] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:04 2022] DELETE /identity/v3/users/b2e41aeff8cd43a1ae221b6cbfce2dab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:05.123850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.135429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55014f99-a76c-47f5-89fc-c9a37a15e40e service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.192901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.194136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.194424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.194701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] PATH_INFO: `/v3/projects/78289a4a0dba461fa416082ae84a1880` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.195878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78289a4a0dba461fa416082ae84a1880)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.197820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.243861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78289a4a0dba461fa416082ae84a1880', 'request_id': 'req-38652786-a4e9-434c-8f52-cb630ca8cb4c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:05.250455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78289a4a0dba461fa416082ae84a1880', 'request_id': 'req-38652786-a4e9-434c-8f52-cb630ca8cb4c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:05.256999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78289a4a0dba461fa416082ae84a1880', 'request_id': 'req-38652786-a4e9-434c-8f52-cb630ca8cb4c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:05.269216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] The token cache is being invalidate because project 78289a4a0dba461fa416082ae84a1880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:05.269504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:05.270166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-38652786-a4e9-434c-8f52-cb630ca8cb4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:05.271705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1218/2444] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:05 2022] DELETE /identity/v3/projects/78289a4a0dba461fa416082ae84a1880 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:05.276579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.276871 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.277158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.297300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:05.298512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:05.355984 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1227/2445] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:05.363716 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.364012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.364299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.385193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:05.386457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:05.394418 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1219/2446] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:05.398807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.408202 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce174bc-be95-405a-8ca0-9cf465763cf1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.413482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.414120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.414399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.414670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.415355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:50:05.415657 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.417260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.418799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:05.431931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1228/2447] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:50:05.436169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.445436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0371ba8-2f89-433c-8735-03757fbc492d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.455922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.456577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.456847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.457125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.457839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.459821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.486658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1220/2448] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:05 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:05.491428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.501189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1d2b-964e-4f51-a547-a0443ab433a5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.556868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.557400 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.557707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.557981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.558638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.560518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.580648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1229/2449] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:05 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:50:05.584847 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.595084 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eee67-3de8-4830-9b60-4faffab0d591 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.600222 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.600828 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.601112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.601388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.602119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.603699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.614154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1221/2450] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:05.618576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.628637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9bc5-77c0-4bad-b5ae-a2dd467e6d92 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.634044 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9340a-32b9-4d68-8e04-74437d7938a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.634672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9340a-32b9-4d68-8e04-74437d7938a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.634963 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9340a-32b9-4d68-8e04-74437d7938a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.635241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9340a-32b9-4d68-8e04-74437d7938a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.635971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9340a-32b9-4d68-8e04-74437d7938a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.637567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9340a-32b9-4d68-8e04-74437d7938a9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.648789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1230/2451] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:05.653733 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.664708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada773f-d77e-4bb1-b58a-e2cfbf31998d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.669517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.670210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.670491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.670797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] PATH_INFO: `/v3/projects/8fd2edcb0b92480dba54655e2cccf84a/users/293551578e5a4ee8a740dafcd6168a59/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.688731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2edcb0b92480dba54655e2cccf84a, user_id=293551578e5a4ee8a740dafcd6168a59, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.691534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.704981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1222/2452] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:05 2022] PUT /identity/v3/projects/8fd2edcb0b92480dba54655e2cccf84a/users/293551578e5a4ee8a740dafcd6168a59/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:05.710775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc0a4-2a75-49ca-8285-4e1397d17526 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.711160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc0a4-2a75-49ca-8285-4e1397d17526 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.711498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc0a4-2a75-49ca-8285-4e1397d17526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.730667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-861bc0a4-2a75-49ca-8285-4e1397d17526 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:05.731881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-861bc0a4-2a75-49ca-8285-4e1397d17526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:05.790789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1231/2453] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:05.800456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:05.803122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:05.817557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:05.862656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f36e9-6207-4668-8cea-d566a99b2981 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:05.866775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:05.867370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:05.867651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:05.867924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:05.876840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:05.878297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:05.890259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1223/2454] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:06.539115 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.539630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.539749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.567744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] MFA Rules not processed for user `293551578e5a4ee8a740dafcd6168a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:06.569547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:06.634247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1232/2455] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:06.640818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:06.650932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249777-538e-4585-af72-539edab7a4f0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:06.655499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:06.656051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.656328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.656606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.657265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:06.659225 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:06.690835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1224/2456] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:06 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:06.692030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:06.697838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:06.705405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c3d6a-efb1-4c49-8720-f920759815c0 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:06.762742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:06.763359 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.763693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.763969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.764631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:06.766579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:06.788362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1233/2457] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:06 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:06.792385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:06.803331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051a286-69ee-4f2b-a4cf-90776b1d0b44 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:06.807910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:06.808512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.808796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.809072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.809795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:06.811396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:06.822294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1225/2458] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:06.826309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:06.836403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62092e-695f-4f1b-8957-66ad57bf3887 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:06.841029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:06.841716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.842002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.842280 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] PATH_INFO: `/v3/projects/3ab243ffcdb74cb1b6d905c95c345462/users/d7275d0cb4204ba08c4e07e288873d59/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.857088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab243ffcdb74cb1b6d905c95c345462, user_id=d7275d0cb4204ba08c4e07e288873d59, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:06.859757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:06.872979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1234/2459] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:06 2022] PUT /identity/v3/projects/3ab243ffcdb74cb1b6d905c95c345462/users/d7275d0cb4204ba08c4e07e288873d59/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:06.876998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:06.886812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9a15-95b3-435b-b84a-a4c25e5cbaad admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:06.942755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edffbe2-627f-47ed-b16b-7a4b7ecda015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:06.943372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffbe2-627f-47ed-b16b-7a4b7ecda015 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.943767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffbe2-627f-47ed-b16b-7a4b7ecda015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.944042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffbe2-627f-47ed-b16b-7a4b7ecda015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.944726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffbe2-627f-47ed-b16b-7a4b7ecda015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:06.946397 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffbe2-627f-47ed-b16b-7a4b7ecda015 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:06.956013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1226/2460] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:06.960331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:06.970311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54027599-ee1f-446d-9657-c7a1e3e4cb24 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:06.975370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:06.976013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:06.976292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:06.976586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] PATH_INFO: `/v3/projects/3ab243ffcdb74cb1b6d905c95c345462/users/d7275d0cb4204ba08c4e07e288873d59/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:06.978567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab243ffcdb74cb1b6d905c95c345462, user_id=d7275d0cb4204ba08c4e07e288873d59, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:06.981158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:06.991829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1235/2461] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:06 2022] PUT /identity/v3/projects/3ab243ffcdb74cb1b6d905c95c345462/users/d7275d0cb4204ba08c4e07e288873d59/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:07.621152 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:07.621467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:07.621777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:07.651193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] MFA Rules not processed for user `d7275d0cb4204ba08c4e07e288873d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:07.652555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:07.720821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1227/2462] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:08.714448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:08.782364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fa075-43ce-4e82-8ce8-a45cc7ff043b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:08.787111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460054-e072-424a-933c-650038e38cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:08.787746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460054-e072-424a-933c-650038e38cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:08.788032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460054-e072-424a-933c-650038e38cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:08.788311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460054-e072-424a-933c-650038e38cea admin admin] PATH_INFO: `/v3/users/293551578e5a4ee8a740dafcd6168a59` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:08.789478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f460054-e072-424a-933c-650038e38cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=293551578e5a4ee8a740dafcd6168a59)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:08.791434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f460054-e072-424a-933c-650038e38cea admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:08.838853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293551578e5a4ee8a740dafcd6168a59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:08.845654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293551578e5a4ee8a740dafcd6168a59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:08.846321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293551578e5a4ee8a740dafcd6168a59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:08.846936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293551578e5a4ee8a740dafcd6168a59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:08.848046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:08.860220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293551578e5a4ee8a740dafcd6168a59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:08.873449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1236/2463] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:08 2022] DELETE /identity/v3/users/293551578e5a4ee8a740dafcd6168a59 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:09.046757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:09.055710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:09.063191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff17d-f8d7-4f14-a4a3-81dc60027776 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:09.126838 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:09.127398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.127677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.127950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] PATH_INFO: `/v3/projects/8fd2edcb0b92480dba54655e2cccf84a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.129146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd2edcb0b92480dba54655e2cccf84a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:09.131252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:09.182720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd2edcb0b92480dba54655e2cccf84a', 'request_id': 'req-bf562670-8339-48cc-9769-759c05d6084c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.189999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd2edcb0b92480dba54655e2cccf84a', 'request_id': 'req-bf562670-8339-48cc-9769-759c05d6084c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.196311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd2edcb0b92480dba54655e2cccf84a', 'request_id': 'req-bf562670-8339-48cc-9769-759c05d6084c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.209891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] The token cache is being invalidate because project 8fd2edcb0b92480dba54655e2cccf84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:09.210176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.210825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.212364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1228/2464] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:09 2022] DELETE /identity/v3/projects/8fd2edcb0b92480dba54655e2cccf84a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:09.216379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:09.217816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:09.231834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460054-e072-424a-933c-650038e38cea admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:09.286868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:09.287500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.287785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.288055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] PATH_INFO: `/v3/users/d7275d0cb4204ba08c4e07e288873d59` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.289213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7275d0cb4204ba08c4e07e288873d59)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:09.291140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:09.336629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7275d0cb4204ba08c4e07e288873d59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.343375 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7275d0cb4204ba08c4e07e288873d59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.344029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7275d0cb4204ba08c4e07e288873d59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.344666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7275d0cb4204ba08c4e07e288873d59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.356335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-bb999a34-a7bf-4a97-a1c3-c006377cdb64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7275d0cb4204ba08c4e07e288873d59'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.368931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1237/2465] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:09 2022] DELETE /identity/v3/users/d7275d0cb4204ba08c4e07e288873d59 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:50:09.543705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:09.545158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:09.559049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562670-8339-48cc-9769-759c05d6084c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:09.615924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:09.616568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.616882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.617161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] PATH_INFO: `/v3/projects/3ab243ffcdb74cb1b6d905c95c345462` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.618343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab243ffcdb74cb1b6d905c95c345462)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:09.620248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:09.658356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:09.669959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab243ffcdb74cb1b6d905c95c345462', 'request_id': 'req-0716fe7b-4829-40af-ac4f-6f032e4e5d33'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.675948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab243ffcdb74cb1b6d905c95c345462', 'request_id': 'req-0716fe7b-4829-40af-ac4f-6f032e4e5d33'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.681857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab243ffcdb74cb1b6d905c95c345462', 'request_id': 'req-0716fe7b-4829-40af-ac4f-6f032e4e5d33'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.694644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] The token cache is being invalidate because project 3ab243ffcdb74cb1b6d905c95c345462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:09.694935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.695554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0716fe7b-4829-40af-ac4f-6f032e4e5d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:09.697049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1229/2466] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:09 2022] DELETE /identity/v3/projects/3ab243ffcdb74cb1b6d905c95c345462 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:09.701935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.702230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.702510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.722547 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:09.724103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:09.781258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:09.796350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1238/2467] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:09.804507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.804797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.805080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.825344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:09.826588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:09.834905 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1230/2468] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:09.839169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:09.848686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db324f2-e186-463c-92d8-8c427195bbb6 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:09.855214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:09.856613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.856898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.857175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.857926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:50:09.858235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:09.859837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:09.872172 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1239/2469] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:50:09.876523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:09.886445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3dfa-761a-4cdb-97bb-3c477dbeebbd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:09.891210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:09.891816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.892128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.892401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.893060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:09.895017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:09.921551 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1231/2470] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:09 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:09.925552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:09.935942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835739e0-2ec1-4313-a75f-ce50178e17c3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:09.990560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:09.991176 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:09.991462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:09.991741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:09.992418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:09.994363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.016805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1240/2471] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:09 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:10.020852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.031864 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437da6e-74d4-4b58-8b26-a115031ae56c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.036423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.037047 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.037331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.037619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.038312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.039898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.050450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1232/2472] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:10.054844 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.064751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb84b2-da2e-40a2-8036-109b39ec0ac6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.069882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314bc1-5e1d-44e8-86a3-af905ad8c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.070491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314bc1-5e1d-44e8-86a3-af905ad8c2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.070784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314bc1-5e1d-44e8-86a3-af905ad8c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.071057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314bc1-5e1d-44e8-86a3-af905ad8c2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.071743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314bc1-5e1d-44e8-86a3-af905ad8c2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.073334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314bc1-5e1d-44e8-86a3-af905ad8c2ee admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.084578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1241/2473] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:50:10.088705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.098790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbef12-3f63-4541-9972-085de7926296 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.103414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.104067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.104351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.104626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] PATH_INFO: `/v3/projects/9c4888b92727456c932218cecd22f761/users/48f1a03d8a13499689950a2cd0df868e/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.118868 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4888b92727456c932218cecd22f761, user_id=48f1a03d8a13499689950a2cd0df868e, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.121538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.134996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1233/2474] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:10 2022] PUT /identity/v3/projects/9c4888b92727456c932218cecd22f761/users/48f1a03d8a13499689950a2cd0df868e/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:10.146835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.147126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.147403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.173999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] MFA Rules not processed for user `48f1a03d8a13499689950a2cd0df868e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:10.175150 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:10.237451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1242/2475] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:10.242310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.305257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575c77e-1633-479c-9423-83e4b9241bab admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.309948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.310563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.310841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.311115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.311788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.313697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.339712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1234/2476] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:10.343699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.354398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b93f3-15a6-438c-8fc8-96c9d1f46498 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.398210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:10.420215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.420856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.421138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.421412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.422132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.424119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.449673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1243/2477] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:10 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:50:10.455233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.470425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57e36b-dc7d-4590-97fe-b7efea7c9148 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.477434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.478441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.478756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.479059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.479875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.482491 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.493450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1235/2478] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:10.497382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.507256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab0567-fbc7-49a9-8ca1-abd85d9484fe admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.511850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4c87-860d-4c87-82da-f8125d3c5214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.512450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4c87-860d-4c87-82da-f8125d3c5214 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.512734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4c87-860d-4c87-82da-f8125d3c5214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.513011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4c87-860d-4c87-82da-f8125d3c5214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.513741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4c87-860d-4c87-82da-f8125d3c5214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.515351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4c87-860d-4c87-82da-f8125d3c5214 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.525701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1244/2479] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:10.529627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.540324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b360db-1d4d-4f2c-8b3d-1410caaf2cf0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.545003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.545684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.545972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.546271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] PATH_INFO: `/v3/projects/13f84b901b794687aea94ba4cdcac163/users/2c1ae10f0a7d4f35899bbefbe098c3fd/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.560879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f84b901b794687aea94ba4cdcac163, user_id=2c1ae10f0a7d4f35899bbefbe098c3fd, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.563584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.575752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1236/2480] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:10 2022] PUT /identity/v3/projects/13f84b901b794687aea94ba4cdcac163/users/2c1ae10f0a7d4f35899bbefbe098c3fd/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:10.586366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.586686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.586975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.614334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] MFA Rules not processed for user `2c1ae10f0a7d4f35899bbefbe098c3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:10.615594 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:10.678333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1245/2481] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:10.682744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.695510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:10.750089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d196cac-8c56-4821-8acf-87a5151f373f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.757883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.758913 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.759453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.759944 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.760930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.762916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.800162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1237/2482] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:10.807621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.823391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c94e1-bb97-4ae7-9925-e6b6934596b7 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.888448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.889069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.889354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.889658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.890330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.892237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.913365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1246/2483] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:10 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:10.917434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.928727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73c5ce-de73-48ab-a801-c3e2264ee4dc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.933253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.934178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.934178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.934438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.935134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.936736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.947789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1238/2484] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:10.951877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:10.962219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe438-72ae-4b67-9a7d-7b7101e26125 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:10.966762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:10.967411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:10.967690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:10.967965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] PATH_INFO: `/v3/projects/d36fa9aaf41945d2a5d8f2db45efe020/users/391d1097aa4a4ce4837e0fdd77432df3/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:10.983182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36fa9aaf41945d2a5d8f2db45efe020, user_id=391d1097aa4a4ce4837e0fdd77432df3, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:10.985877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:10.998557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1247/2485] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:10 2022] PUT /identity/v3/projects/d36fa9aaf41945d2a5d8f2db45efe020/users/391d1097aa4a4ce4837e0fdd77432df3/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:50:11.002439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:11.012723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e064-a2e6-4d30-91e4-c53c17da303d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:11.070305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219040ba-0abb-4b98-8b18-d33a4420d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:11.070998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219040ba-0abb-4b98-8b18-d33a4420d5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:11.071195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219040ba-0abb-4b98-8b18-d33a4420d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:11.071473 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219040ba-0abb-4b98-8b18-d33a4420d5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:11.072169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219040ba-0abb-4b98-8b18-d33a4420d5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:11.073794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219040ba-0abb-4b98-8b18-d33a4420d5e1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:11.084004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1239/2486] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:11.088116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:11.098361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90682b8-5f72-4f96-8068-dd6e621bfc14 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:11.103485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:11.104129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:11.104406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:11.104673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] PATH_INFO: `/v3/projects/d36fa9aaf41945d2a5d8f2db45efe020/users/391d1097aa4a4ce4837e0fdd77432df3/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:11.106883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36fa9aaf41945d2a5d8f2db45efe020, user_id=391d1097aa4a4ce4837e0fdd77432df3, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:11.109472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:11.119760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1248/2487] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:11 2022] PUT /identity/v3/projects/d36fa9aaf41945d2a5d8f2db45efe020/users/391d1097aa4a4ce4837e0fdd77432df3/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:11.130091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:11.130454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:11.130739 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:11.159091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] MFA Rules not processed for user `391d1097aa4a4ce4837e0fdd77432df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:11.160306 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:11.230489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1240/2488] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:11.241880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:11.243550 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:11.254205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:11.301042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc44063-2af0-4381-a02b-fcb1f810e97d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:11.304902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:11.305509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:11.305825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:11.306097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:11.315358 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:11.316770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:11.325970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1249/2489] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:11.367427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:11.368814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:11.381235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c361-e65a-4745-aceb-75eb47103ff7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:11.385033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79582dd2-a59d-4fcf-a346-b72374b6d876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:11.385683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79582dd2-a59d-4fcf-a346-b72374b6d876 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:11.385975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79582dd2-a59d-4fcf-a346-b72374b6d876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:11.386259 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79582dd2-a59d-4fcf-a346-b72374b6d876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:11.390460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:11.445389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79582dd2-a59d-4fcf-a346-b72374b6d876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:11.446866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79582dd2-a59d-4fcf-a346-b72374b6d876 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:11.456063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1241/2490] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:14.309613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:14.372933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b60c-f5b4-4ff6-99b7-7102d50643fe service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:14.377641 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:14.378275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:14.378585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:14.378864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] PATH_INFO: `/v3/users/48f1a03d8a13499689950a2cd0df868e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:14.380022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f1a03d8a13499689950a2cd0df868e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:14.381997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:14.426971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f1a03d8a13499689950a2cd0df868e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.434697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f1a03d8a13499689950a2cd0df868e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.435370 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f1a03d8a13499689950a2cd0df868e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.435999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f1a03d8a13499689950a2cd0df868e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.447584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f1a03d8a13499689950a2cd0df868e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.459431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1250/2491] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:14 2022] DELETE /identity/v3/users/48f1a03d8a13499689950a2cd0df868e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:14.463851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:14.464315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:14.464398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:14.484494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:14.485721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:14.543539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1242/2492] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:14.553589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:14.554990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:14.589556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:14.615147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e9114-8425-47f7-86b9-a3998b5dc9dd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:14.619114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:14.619726 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:14.620012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:14.620290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:14.629235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:14.631313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:14.640891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1251/2493] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:50:14.906236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:14.907666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:14.920173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8fc8-7d39-4c5c-a59e-49f687e78a45 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:14.924850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:14.925492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:14.925809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:14.926087 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] PATH_INFO: `/v3/projects/9c4888b92727456c932218cecd22f761` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:14.928023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4888b92727456c932218cecd22f761)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:14.930310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:14.977712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4888b92727456c932218cecd22f761', 'request_id': 'req-23ef7ef2-5970-4d46-b91a-94799e5b2077'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.983682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4888b92727456c932218cecd22f761', 'request_id': 'req-23ef7ef2-5970-4d46-b91a-94799e5b2077'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:14.989132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4888b92727456c932218cecd22f761', 'request_id': 'req-23ef7ef2-5970-4d46-b91a-94799e5b2077'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.001317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] The token cache is being invalidate because project 9c4888b92727456c932218cecd22f761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:15.001626 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.002253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.003738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1243/2494] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:14 2022] DELETE /identity/v3/projects/9c4888b92727456c932218cecd22f761 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:15.008353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:15.017990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbdb8b-a2d8-4b4e-9937-aedf679c5301 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:15.073137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:15.073790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:15.074076 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:15.074351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] PATH_INFO: `/v3/users/2c1ae10f0a7d4f35899bbefbe098c3fd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:15.075508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1ae10f0a7d4f35899bbefbe098c3fd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:15.077419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:15.123283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1ae10f0a7d4f35899bbefbe098c3fd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.130616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1ae10f0a7d4f35899bbefbe098c3fd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.131241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1ae10f0a7d4f35899bbefbe098c3fd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.131839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1ae10f0a7d4f35899bbefbe098c3fd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.143757 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1ae10f0a7d4f35899bbefbe098c3fd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.157240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1252/2495] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:15 2022] DELETE /identity/v3/users/2c1ae10f0a7d4f35899bbefbe098c3fd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:15.484890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:15.486389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:15.500133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7ef2-5970-4d46-b91a-94799e5b2077 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:15.527827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:15.564512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:15.565190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:15.565468 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:15.565789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] PATH_INFO: `/v3/projects/13f84b901b794687aea94ba4cdcac163` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:15.567051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f84b901b794687aea94ba4cdcac163)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:15.569675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:15.615777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f84b901b794687aea94ba4cdcac163', 'request_id': 'req-d6567e8d-3312-4bc6-830d-92f69de061f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.623359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f84b901b794687aea94ba4cdcac163', 'request_id': 'req-d6567e8d-3312-4bc6-830d-92f69de061f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.630869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f84b901b794687aea94ba4cdcac163', 'request_id': 'req-d6567e8d-3312-4bc6-830d-92f69de061f8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.643921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] The token cache is being invalidate because project 13f84b901b794687aea94ba4cdcac163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:15.644164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.644778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.646858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1244/2496] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:15 2022] DELETE /identity/v3/projects/13f84b901b794687aea94ba4cdcac163 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:15.650878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:15.652288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:15.664962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79ceaa-9a14-477e-9f9d-3cf4e7553f5f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:15.716074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:15.726919 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:15.727668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:15.728016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:15.728377 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] PATH_INFO: `/v3/users/391d1097aa4a4ce4837e0fdd77432df3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:15.729650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=391d1097aa4a4ce4837e0fdd77432df3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:15.731803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:15.781013 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391d1097aa4a4ce4837e0fdd77432df3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.787973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391d1097aa4a4ce4837e0fdd77432df3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.788669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391d1097aa4a4ce4837e0fdd77432df3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.789282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391d1097aa4a4ce4837e0fdd77432df3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.805374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2899e0dd-2d7a-43e7-a80b-272755faee5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391d1097aa4a4ce4837e0fdd77432df3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:15.820521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1253/2497] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:15 2022] DELETE /identity/v3/users/391d1097aa4a4ce4837e0fdd77432df3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:16.106513 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.107958 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:16.124344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6567e8d-3312-4bc6-830d-92f69de061f8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.183646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.184289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.184572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.184849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] PATH_INFO: `/v3/projects/d36fa9aaf41945d2a5d8f2db45efe020` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.186035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36fa9aaf41945d2a5d8f2db45efe020)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.187954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.252675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36fa9aaf41945d2a5d8f2db45efe020', 'request_id': 'req-779d918d-6380-4ccd-af1d-73c9ad2087e3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:16.258976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36fa9aaf41945d2a5d8f2db45efe020', 'request_id': 'req-779d918d-6380-4ccd-af1d-73c9ad2087e3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:16.263635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:16.264860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36fa9aaf41945d2a5d8f2db45efe020', 'request_id': 'req-779d918d-6380-4ccd-af1d-73c9ad2087e3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:16.279399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] The token cache is being invalidate because project d36fa9aaf41945d2a5d8f2db45efe020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:16.279691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:16.280328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-779d918d-6380-4ccd-af1d-73c9ad2087e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:16.281875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1245/2498] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:16 2022] DELETE /identity/v3/projects/d36fa9aaf41945d2a5d8f2db45efe020 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:16.288339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.288632 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.288908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.308161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:16.309297 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:16.368255 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1254/2499] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:16.377865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.378158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.378440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.398968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:16.400213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:16.408256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1246/2500] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:16.413010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.422610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad54b0-d17f-40e0-8ef0-771d1c340b08 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.428142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.428746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.429027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.429327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.430051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:50:16.430357 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.431939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.443742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1255/2501] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:50:16.447999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.457042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722d099-b64b-449d-b161-ed1a5544ed53 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.462239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.462837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.463118 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.463395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.464061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.465996 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.493477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1247/2502] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:16.497092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.506847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f56110-5e37-41fd-a5a1-67682786c909 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.562944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.563473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.563755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.564030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.564678 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.566617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.574269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:16.589301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1256/2503] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:16 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:50:16.593451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.604389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba778f-2bcf-45a9-b166-30c6d15fc1d9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.608896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.609508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.609806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.610080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.610758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.612366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.622215 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1248/2504] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:16.625922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.636570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79570588-01d6-4501-ac0e-bc52f228d3f7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.641135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aeece-b542-4ade-b4a4-89493eda7d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.641765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aeece-b542-4ade-b4a4-89493eda7d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.642047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aeece-b542-4ade-b4a4-89493eda7d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.642322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aeece-b542-4ade-b4a4-89493eda7d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.643006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aeece-b542-4ade-b4a4-89493eda7d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.644605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aeece-b542-4ade-b4a4-89493eda7d31 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.655546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1257/2505] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:50:16.659514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.669189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dab1d4-2ab8-48e0-a15c-3d7e297e78bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.673723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.674367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.674650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.674928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] PATH_INFO: `/v3/projects/3c20779e761c444bb62753198dcb1080/users/857237021cd14e22b707a257b215cd52/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.689408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c20779e761c444bb62753198dcb1080, user_id=857237021cd14e22b707a257b215cd52, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.692453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.706454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1249/2506] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:16 2022] PUT /identity/v3/projects/3c20779e761c444bb62753198dcb1080/users/857237021cd14e22b707a257b215cd52/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:50:16.717700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.717990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.718267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.746460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] MFA Rules not processed for user `857237021cd14e22b707a257b215cd52`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:16.747654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:16.813242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1258/2507] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:16.824878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:16.826611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:16.882615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31b040-ff6a-4d87-a0f6-1a12deebf706 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:16.886267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba653c-f0a0-45b1-a2e9-14bab75efcd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:16.886890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba653c-f0a0-45b1-a2e9-14bab75efcd5 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:16.887177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba653c-f0a0-45b1-a2e9-14bab75efcd5 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:16.887454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba653c-f0a0-45b1-a2e9-14bab75efcd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:16.896337 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba653c-f0a0-45b1-a2e9-14bab75efcd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:16.897807 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba653c-f0a0-45b1-a2e9-14bab75efcd5 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:16.906615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1250/2508] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:26.810332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:26.902665 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=56,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:39.729702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:39.795305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1bffe-d819-4570-8f36-fb63f55146bf None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:39.800242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:39.800884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:39.801166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:39.801729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] PATH_INFO: `/v3/users/857237021cd14e22b707a257b215cd52` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:39.802925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857237021cd14e22b707a257b215cd52)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:39.804842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:39.850669 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857237021cd14e22b707a257b215cd52'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:39.857725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857237021cd14e22b707a257b215cd52'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:39.858407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857237021cd14e22b707a257b215cd52'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:39.859022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857237021cd14e22b707a257b215cd52'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:39.870853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857237021cd14e22b707a257b215cd52'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:39.883476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1259/2509] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:39 2022] DELETE /identity/v3/users/857237021cd14e22b707a257b215cd52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:39.887881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:39.888379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:39.888501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:39.906801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:39.908029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:39.967762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1251/2510] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:39.978072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:39.979490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:40.038310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014169dd-39a1-4386-a964-a63c9efa9326 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.041868 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabd35f-1569-4e05-bcc9-bf70c365ce68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.042476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd35f-1569-4e05-bcc9-bf70c365ce68 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.042756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd35f-1569-4e05-bcc9-bf70c365ce68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.043027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabd35f-1569-4e05-bcc9-bf70c365ce68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.051990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabd35f-1569-4e05-bcc9-bf70c365ce68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.053437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabd35f-1569-4e05-bcc9-bf70c365ce68 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.062623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1260/2511] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:40.325295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.326890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:40.340134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5e15-6cc8-4383-9605-968392b607fb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.345607 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.346629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.346916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.347224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] PATH_INFO: `/v3/projects/3c20779e761c444bb62753198dcb1080` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.348510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c20779e761c444bb62753198dcb1080)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.350640 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.398151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c20779e761c444bb62753198dcb1080', 'request_id': 'req-f2df7527-c7e0-4654-8362-15bcc85932c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:40.404217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c20779e761c444bb62753198dcb1080', 'request_id': 'req-f2df7527-c7e0-4654-8362-15bcc85932c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:40.409738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c20779e761c444bb62753198dcb1080', 'request_id': 'req-f2df7527-c7e0-4654-8362-15bcc85932c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:40.422606 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] The token cache is being invalidate because project 3c20779e761c444bb62753198dcb1080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:40.422896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:40.423518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f2df7527-c7e0-4654-8362-15bcc85932c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:40.425076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1252/2512] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:40 2022] DELETE /identity/v3/projects/3c20779e761c444bb62753198dcb1080 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:40.430799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.431179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.431463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.451382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:40.452584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:40.469089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:40.512128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1261/2513] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:40.519942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.520229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.520504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.539399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:40.540583 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:40.548341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1253/2514] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:40.553084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.562804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2470a0-0877-4f0d-8328-07c7471b60a1 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.567534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.568754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.569069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.569347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.570112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:50:40.570454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.572078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.583499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1262/2515] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:50:40.587645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.596671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7e201-bff6-4661-8407-b7d92b0411ea None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.601772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.602364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.602644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.602915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.603570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.605445 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.632359 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1254/2516] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:40 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:50:40.637954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.650309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a417ac9-8269-4dea-94ab-f1ee4700baff admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.706526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.707063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.707345 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.707623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.708305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.710934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.731393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1263/2517] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:40 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:40.735521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.747492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5adb-018a-4e32-9f98-3db4067eb262 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.752203 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.752858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.753122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.753400 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.754168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.755811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.766997 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1255/2518] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:40.770856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.780791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce23f-a23c-4830-b66c-a5aa02b172ee admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.785410 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d59ea7-2ba7-469e-8865-b657ff6eb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.786051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59ea7-2ba7-469e-8865-b657ff6eb271 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.786337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59ea7-2ba7-469e-8865-b657ff6eb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.786615 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59ea7-2ba7-469e-8865-b657ff6eb271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.787817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d59ea7-2ba7-469e-8865-b657ff6eb271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.789399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d59ea7-2ba7-469e-8865-b657ff6eb271 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.799665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1264/2519] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:40.804442 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.814408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3c13e-1ae2-4151-bbca-076e80f9ed0b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:40.819023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:40.819669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.819957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.820236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] PATH_INFO: `/v3/projects/0c96df5691f9429e86b9cd7f1f808b68/users/714029ec31d6488bb7264867a5b6c44f/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.834540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c96df5691f9429e86b9cd7f1f808b68, user_id=714029ec31d6488bb7264867a5b6c44f, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:40.837220 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:40.850763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1256/2520] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:40 2022] PUT /identity/v3/projects/0c96df5691f9429e86b9cd7f1f808b68/users/714029ec31d6488bb7264867a5b6c44f/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:40.860835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:40.861126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:40.861401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:40.889496 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] MFA Rules not processed for user `714029ec31d6488bb7264867a5b6c44f`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:40.890731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:40.957339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1265/2521] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:40.968914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:40.970718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:40.992924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:41.028946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c794c-7092-4a6e-bdc9-8d7c25be016a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:41.032968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445ee3-0fc5-4373-906f-341acba10d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:41.033584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445ee3-0fc5-4373-906f-341acba10d67 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:41.033898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445ee3-0fc5-4373-906f-341acba10d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:41.034181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445ee3-0fc5-4373-906f-341acba10d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:41.043395 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445ee3-0fc5-4373-906f-341acba10d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:41.045142 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445ee3-0fc5-4373-906f-341acba10d67 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:41.054552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1257/2522] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:43.598299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:43.617877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:43.662311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a677a-c96c-4c6f-8fc6-5b185cec6678 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:43.666926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:43.667565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:43.667847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:43.668130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] PATH_INFO: `/v3/users/714029ec31d6488bb7264867a5b6c44f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:43.669329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=714029ec31d6488bb7264867a5b6c44f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:43.671279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:43.715667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714029ec31d6488bb7264867a5b6c44f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:43.722600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714029ec31d6488bb7264867a5b6c44f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:43.723249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714029ec31d6488bb7264867a5b6c44f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:43.723852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714029ec31d6488bb7264867a5b6c44f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:43.735885 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714029ec31d6488bb7264867a5b6c44f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:43.748522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1266/2523] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:50:43 2022] DELETE /identity/v3/users/714029ec31d6488bb7264867a5b6c44f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:43.752943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:43.753413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:43.753515 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:43.773882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:43.775263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:43.833723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1258/2524] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:43.843230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:43.844668 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:43.902038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4d17-fa1f-4997-9a21-2cdd93adb67d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:43.905706 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194bfcd-396f-4bff-b209-e8c44ce3ca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:43.906317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194bfcd-396f-4bff-b209-e8c44ce3ca79 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:43.906606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194bfcd-396f-4bff-b209-e8c44ce3ca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:43.906886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194bfcd-396f-4bff-b209-e8c44ce3ca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:43.916328 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194bfcd-396f-4bff-b209-e8c44ce3ca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:43.917791 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194bfcd-396f-4bff-b209-e8c44ce3ca79 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:43.928154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1267/2525] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:44.190563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.191986 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:44.204139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655af8-d56d-437b-9cb6-651f2bf97553 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.209522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.210189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.210464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.210737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] PATH_INFO: `/v3/projects/0c96df5691f9429e86b9cd7f1f808b68` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.212013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c96df5691f9429e86b9cd7f1f808b68)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.214088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.260793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c96df5691f9429e86b9cd7f1f808b68', 'request_id': 'req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:44.267171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c96df5691f9429e86b9cd7f1f808b68', 'request_id': 'req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:44.273109 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c96df5691f9429e86b9cd7f1f808b68', 'request_id': 'req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:44.285869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] The token cache is being invalidate because project 0c96df5691f9429e86b9cd7f1f808b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:50:44.286158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:44.287393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c96cb2d6-2176-405a-ad12-70ad7fc5fb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:50:44.288926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1259/2526] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:50:44 2022] DELETE /identity/v3/projects/0c96df5691f9429e86b9cd7f1f808b68 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:44.293907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.294191 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.294461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.313351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:44.314576 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:44.347403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:44.374097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1268/2527] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:44.382424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.382714 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.382990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.402799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:44.403999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:44.411813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1260/2528] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:44.415884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.425573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9a70-e728-4caa-8756-ebc167b81850 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.430418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.431026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.431313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.431589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.432276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:50:44.432585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.434205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.445972 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1269/2529] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:50:44.450019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.459782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b32c-640e-4ab6-9453-8ce816e00c99 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.464370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.464967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.465250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.465528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.466218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.468110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.494616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1261/2530] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:50:44 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:50:44.498687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.508937 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447bdf6-0a72-41f2-bd50-812f2e5bd0a8 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.562419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.563018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.563298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.563571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.564234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.566167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.587354 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1270/2531] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:50:44 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:50:44.591542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.601841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab80b3-2dfb-4491-9391-761ced6e6cd5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.606528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.607136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.607420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.607696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.608383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.610027 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.619660 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1262/2532] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:44.623276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.633507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8fef4-5a4a-4de5-b1f5-5ca79dfd97c6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.637976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dffb4-d333-4526-9806-6d51be1627e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.638566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dffb4-d333-4526-9806-6d51be1627e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.638841 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dffb4-d333-4526-9806-6d51be1627e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.639111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dffb4-d333-4526-9806-6d51be1627e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.639789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dffb4-d333-4526-9806-6d51be1627e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.641355 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dffb4-d333-4526-9806-6d51be1627e8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.652209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1271/2533] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:50:44.656019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.666050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec30fd5-c076-4703-89f0-6f2df053459f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.670978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.671667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.671914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.672192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] PATH_INFO: `/v3/projects/f3d0d94091314bc98e7263d11908e307/users/522825f8e7b9422d89665569a185bf39/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.674596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:44.690270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d0d94091314bc98e7263d11908e307, user_id=522825f8e7b9422d89665569a185bf39, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.693684 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.705779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1263/2534] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:50:44 2022] PUT /identity/v3/projects/f3d0d94091314bc98e7263d11908e307/users/522825f8e7b9422d89665569a185bf39/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:50:44.772468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.780888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.781200 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.809338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] MFA Rules not processed for user `522825f8e7b9422d89665569a185bf39`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:50:44.810823 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:44.873906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1272/2535] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:50:44.885755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:50:44.887528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:50:44.945392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162585a8-fc1b-4c44-8af2-0ba960dea10f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:50:44.949053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed17d0-821e-4b0e-a461-c0c1e7f8b6bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:50:44.949704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed17d0-821e-4b0e-a461-c0c1e7f8b6bd service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:50:44.949991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed17d0-821e-4b0e-a461-c0c1e7f8b6bd service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:50:44.950270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed17d0-821e-4b0e-a461-c0c1e7f8b6bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:50:44.958637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed17d0-821e-4b0e-a461-c0c1e7f8b6bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:50:44.960076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed17d0-821e-4b0e-a461-c0c1e7f8b6bd service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:50:44.968902 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1264/2536] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:50:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:50:54.871028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:54.964898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:00.394440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:00.396519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:00.461896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49e069-7f6d-49a7-9ae8-d87bef0034a2 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:00.465415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:00.466066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:00.466352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:00.466629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:00.468415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:00.533566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:00.535026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:00.544139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1273/2537] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:02.021183 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba6fd-fff2-42bd-8efb-2d56f80e5071 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:02.021732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba6fd-fff2-42bd-8efb-2d56f80e5071 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:02.021833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba6fd-fff2-42bd-8efb-2d56f80e5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:02.040874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d82ba6fd-fff2-42bd-8efb-2d56f80e5071 None None] MFA Rules not processed for user `8990ee8f728f4dea9686b4819ee28fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:02.042111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d82ba6fd-fff2-42bd-8efb-2d56f80e5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:02.097500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1265/2538] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:06.730397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:06.751049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789f53a-1497-40a7-a644-d3e07b6254f6 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:06.755301 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:06.755910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:06.756311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:06.756451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:06.758196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:06.870363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:06.889892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:06.891563 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd54b-c3b7-4063-b4b3-4b9ea292f80a service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:06.915614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1274/2539] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:12.091264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:12.564978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aae948-b02f-46cc-a392-0e5f01bd335a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:12.565682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aae948-b02f-46cc-a392-0e5f01bd335a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:12.565682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aae948-b02f-46cc-a392-0e5f01bd335a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:12.567622 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1266/2540] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:51:12.600776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:12.602231 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:12.602490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:12.735847 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] MFA Rules not processed for user `69d05210f0894bec881969d3ae3ad4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:12.737966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:12.848716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1275/2541] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:51:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:12.866367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aae948-b02f-46cc-a392-0e5f01bd335a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:12.868089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24aae948-b02f-46cc-a392-0e5f01bd335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:12.895173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aae948-b02f-46cc-a392-0e5f01bd335a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:12.901052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e3c0-6576-4e27-9e02-d238d9d2767f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:12.901825 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e3c0-6576-4e27-9e02-d238d9d2767f service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:12.902255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e3c0-6576-4e27-9e02-d238d9d2767f service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:12.902599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e3c0-6576-4e27-9e02-d238d9d2767f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:12.911589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5e3c0-6576-4e27-9e02-d238d9d2767f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:12.913276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5e3c0-6576-4e27-9e02-d238d9d2767f service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:12.923934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1267/2542] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:14.280429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:14.291428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a017-7a5e-4958-8975-39837b9f5485 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:14.296435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:14.297201 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:14.297765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:14.298240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] PATH_INFO: `/v3/users/522825f8e7b9422d89665569a185bf39` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:14.299648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522825f8e7b9422d89665569a185bf39)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:14.302682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:14.369001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522825f8e7b9422d89665569a185bf39'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:14.380088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522825f8e7b9422d89665569a185bf39'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:14.380856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522825f8e7b9422d89665569a185bf39'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:14.381542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522825f8e7b9422d89665569a185bf39'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:14.395165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:14.396659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522825f8e7b9422d89665569a185bf39'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:14.414821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1276/2543] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:51:14 2022] DELETE /identity/v3/users/522825f8e7b9422d89665569a185bf39 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:14.419358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:14.420239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:14.422148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:14.456758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:14.458240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:14.531803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1268/2544] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:14.542423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:14.543853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:14.615268 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f232-40a6-4577-8da8-147b22fc8fe5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:14.621143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13fcd1-2d52-4635-b04f-62678bdb7d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:14.622406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13fcd1-2d52-4635-b04f-62678bdb7d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:14.622930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13fcd1-2d52-4635-b04f-62678bdb7d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:14.623441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13fcd1-2d52-4635-b04f-62678bdb7d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:14.640524 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13fcd1-2d52-4635-b04f-62678bdb7d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:14.641905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13fcd1-2d52-4635-b04f-62678bdb7d2c service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:14.653566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1277/2545] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:14.998502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.000284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:15.022924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d438-5623-4177-bc46-72a3142869d0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.029500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.030485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.030781 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.031061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] PATH_INFO: `/v3/projects/f3d0d94091314bc98e7263d11908e307` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.032252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d0d94091314bc98e7263d11908e307)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.034425 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.102995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d0d94091314bc98e7263d11908e307', 'request_id': 'req-d886331b-63f4-47bb-a60a-72adc7cee12b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:15.110453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d0d94091314bc98e7263d11908e307', 'request_id': 'req-d886331b-63f4-47bb-a60a-72adc7cee12b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:15.116566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d0d94091314bc98e7263d11908e307', 'request_id': 'req-d886331b-63f4-47bb-a60a-72adc7cee12b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:15.129882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] The token cache is being invalidate because project f3d0d94091314bc98e7263d11908e307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:51:15.130187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:15.130827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d886331b-63f4-47bb-a60a-72adc7cee12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:15.132428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1269/2546] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:51:14 2022] DELETE /identity/v3/projects/f3d0d94091314bc98e7263d11908e307 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:15.137577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.137881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.138167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.199891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:15.201504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:15.266110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1278/2547] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:51:15.274342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.274638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.274920 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.295276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:15.296495 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:15.305029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1270/2548] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:15.309283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.319597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400541-fe32-4ba7-af5f-9b2e0a9e3809 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.324178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.324788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.325066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.325339 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.328544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:51:15.328855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.330484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.343557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1279/2549] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:51:15.348271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.359498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad2844-caa4-4e65-a281-e48fb7191fa2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.365249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.366040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.366040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.366265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.367012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.369033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.406451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1271/2550] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:51:15 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:51:15.410917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.421464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ba313-c510-46c7-962f-a30093f45950 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.504766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.505388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.505796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.506068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.506742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.508679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.521151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:15.536948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1280/2551] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:51:15 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:51:15.541126 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.552879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307af61f-d70c-4979-a808-da0eec0fb0ea admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.558072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.558689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.558976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.559245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.560111 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.561747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.572463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1272/2552] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:51:15.576624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.586929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86e5f-fbdb-4c97-a1a0-7f0c4ccb27ed admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.592121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd1d92-bd8c-480d-9d7c-691f148fef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.592631 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd1d92-bd8c-480d-9d7c-691f148fef85 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.592920 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd1d92-bd8c-480d-9d7c-691f148fef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.593198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd1d92-bd8c-480d-9d7c-691f148fef85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.594275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd1d92-bd8c-480d-9d7c-691f148fef85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.595712 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd1d92-bd8c-480d-9d7c-691f148fef85 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.609335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1281/2553] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:51:15.614008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.628639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93afc2-fae5-4a58-818a-33090d3bf7dc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.636403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.637098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.637417 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.637754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] PATH_INFO: `/v3/projects/7c551c1c6ea74542b33f768205dab765/users/072aff24ff9d4f5b91ede8e2e7ec7dd6/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.654925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c551c1c6ea74542b33f768205dab765, user_id=072aff24ff9d4f5b91ede8e2e7ec7dd6, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:15.658074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:15.674017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:15.685898 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1273/2554] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:51:15 2022] PUT /identity/v3/projects/7c551c1c6ea74542b33f768205dab765/users/072aff24ff9d4f5b91ede8e2e7ec7dd6/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:15.695284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.695614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.696361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:15.753429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] MFA Rules not processed for user `072aff24ff9d4f5b91ede8e2e7ec7dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:15.755291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:15.862022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1282/2555] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:15.874528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:15.877436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:15.985534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49462c-9d0d-4071-90b4-fb625b9d9975 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:15.989399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:15.990056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:15.990343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:15.990623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:16.000179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:16.002197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:16.011451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1274/2556] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:16.487227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:16.491485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:16.574144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666247-0f08-4a96-bf5d-3c392ebcd907 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:16.578673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:16.579306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:16.579581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:16.579855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] PATH_INFO: `/v3/users/abd1937e53d34b53b1415ae97f9a04bb` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:16.581010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd1937e53d34b53b1415ae97f9a04bb)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:16.583628 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:16.632727 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd1937e53d34b53b1415ae97f9a04bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:16.639872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd1937e53d34b53b1415ae97f9a04bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:16.640571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd1937e53d34b53b1415ae97f9a04bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:16.641184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd1937e53d34b53b1415ae97f9a04bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:16.655159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd1937e53d34b53b1415ae97f9a04bb'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:16.657880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:16.668361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1283/2557] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:51:16 2022] DELETE /identity/v3/users/abd1937e53d34b53b1415ae97f9a04bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:16.856509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:16.875879 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486acb-93d5-4483-9c34-92f56eb32e57 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:16.938253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:16.939175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:16.939667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:16.940135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] PATH_INFO: `/v3/projects/efd99b7114b44484a297c84fefb7e19f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:16.942205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd99b7114b44484a297c84fefb7e19f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:16.944361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:16.993140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd99b7114b44484a297c84fefb7e19f', 'request_id': 'req-a6ebc056-ce96-4242-9663-ef9addfbb120'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.000210 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd99b7114b44484a297c84fefb7e19f', 'request_id': 'req-a6ebc056-ce96-4242-9663-ef9addfbb120'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.008171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd99b7114b44484a297c84fefb7e19f', 'request_id': 'req-a6ebc056-ce96-4242-9663-ef9addfbb120'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.022351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] The token cache is being invalidate because project efd99b7114b44484a297c84fefb7e19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:51:17.022646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.023291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.025082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1275/2558] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:51:16 2022] DELETE /identity/v3/projects/efd99b7114b44484a297c84fefb7e19f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:17.029264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:17.030882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:17.044805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41218f-2207-4c32-98cd-b4023d6aa267 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:17.101877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:17.102516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:17.102804 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:17.103171 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] PATH_INFO: `/v3/users/41212e62ee6a4ccdacb1431525b53e48` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:17.104349 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41212e62ee6a4ccdacb1431525b53e48)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:17.106317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:17.158285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41212e62ee6a4ccdacb1431525b53e48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.166940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41212e62ee6a4ccdacb1431525b53e48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.167689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41212e62ee6a4ccdacb1431525b53e48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.168284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41212e62ee6a4ccdacb1431525b53e48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.182093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41212e62ee6a4ccdacb1431525b53e48'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:17.197139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1284/2559] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:51:17 2022] DELETE /identity/v3/users/41212e62ee6a4ccdacb1431525b53e48 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:51:17.223691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:17.225154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:17.274878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:17.318915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc056-ce96-4242-9663-ef9addfbb120 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:17.390466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:17.391276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:17.391557 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:17.391829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:17.395365 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:17.423881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:17.425616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef6c66-2594-41fb-bc87-9b633de5eb3c service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:17.443648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1276/2560] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:17.995197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:17.997851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:18.092131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d9cd-da9b-49ac-b882-92320b5e7581 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:18.098766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:18.099977 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:18.100737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:18.101236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] PATH_INFO: `/v3/projects/2b2a5df40ef24392ab4bedfb5ae6cf54` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:18.103924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2a5df40ef24392ab4bedfb5ae6cf54)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:18.106390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:18.122283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:18.199849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2a5df40ef24392ab4bedfb5ae6cf54', 'request_id': 'req-eb42bba7-00dd-4838-889e-6b12315e47a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:18.209976 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2a5df40ef24392ab4bedfb5ae6cf54', 'request_id': 'req-eb42bba7-00dd-4838-889e-6b12315e47a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:18.217382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2a5df40ef24392ab4bedfb5ae6cf54', 'request_id': 'req-eb42bba7-00dd-4838-889e-6b12315e47a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:18.240226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] The token cache is being invalidate because project 2b2a5df40ef24392ab4bedfb5ae6cf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:51:18.240531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:18.241258 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:18.245888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1285/2561] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:51:17 2022] DELETE /identity/v3/projects/2b2a5df40ef24392ab4bedfb5ae6cf54 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:18.828749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:18.829247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:18.829368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:18.849836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:18.851927 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:18.920942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1277/2562] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 29 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:18.976625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:18.978179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:19.056315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42bba7-00dd-4838-889e-6b12315e47a5 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:19.061511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:19.062222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:19.062517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:19.063334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:19.071857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:19.074101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:19.082912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1286/2563] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 04:51:22.329916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:22.331544 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:22.405967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:22.416945 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f96c6-20e4-4f38-9d61-d6c13a92bfab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:22.420654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:22.421274 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:22.421560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:22.421881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:22.423668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:22.505712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:22.507292 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:22.517051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1278/2564] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:26.463813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:26.465314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:26.486445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db6f62-2817-4465-af0f-801e2ef0bc6d service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:26.493472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:26.493824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:26.494141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:26.494463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] PATH_INFO: `/v3/users/d6c206952a7b4543884455fa748cbf77` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:26.495685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c206952a7b4543884455fa748cbf77)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:26.497627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:26.549100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c206952a7b4543884455fa748cbf77'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.556821 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c206952a7b4543884455fa748cbf77'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.557478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c206952a7b4543884455fa748cbf77'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.558127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c206952a7b4543884455fa748cbf77'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.569759 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c206952a7b4543884455fa748cbf77'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.582487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1287/2565] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:51:26 2022] DELETE /identity/v3/users/d6c206952a7b4543884455fa748cbf77 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:26.760392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:26.780107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4b13f-7746-438d-a8ed-d729c4a32b3b service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:26.840800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:26.841440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:26.841770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:26.842068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] PATH_INFO: `/v3/projects/f708a9d1759441d98c73f96ab58559fe` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:26.843238 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f708a9d1759441d98c73f96ab58559fe)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:26.845139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:26.889778 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f708a9d1759441d98c73f96ab58559fe', 'request_id': 'req-5eff83ca-854a-4d16-900b-d5db9b9d28a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.896296 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f708a9d1759441d98c73f96ab58559fe', 'request_id': 'req-5eff83ca-854a-4d16-900b-d5db9b9d28a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.901954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f708a9d1759441d98c73f96ab58559fe', 'request_id': 'req-5eff83ca-854a-4d16-900b-d5db9b9d28a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.915416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] The token cache is being invalidate because project f708a9d1759441d98c73f96ab58559fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:51:26.915706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.916323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:26.917890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1279/2566] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:51:26 2022] DELETE /identity/v3/projects/f708a9d1759441d98c73f96ab58559fe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:26.922009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:26.923448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:26.931911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:26.938610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873831-b2f5-4054-827c-a3dc509bc061 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:26.994820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:26.995449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:26.995731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:26.996003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] PATH_INFO: `/v3/users/f8d2b64bb8c0461b9fecc1c0b4e46b63` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:26.997164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d2b64bb8c0461b9fecc1c0b4e46b63)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:26.999093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:27.045149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d2b64bb8c0461b9fecc1c0b4e46b63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.052430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d2b64bb8c0461b9fecc1c0b4e46b63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.053133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d2b64bb8c0461b9fecc1c0b4e46b63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.053785 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d2b64bb8c0461b9fecc1c0b4e46b63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.065314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-60928bcf-e7cd-4133-b7e1-48385d826d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d2b64bb8c0461b9fecc1c0b4e46b63'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.078078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1288/2567] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:51:26 2022] DELETE /identity/v3/users/f8d2b64bb8c0461b9fecc1c0b4e46b63 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:27.249116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:27.250571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:27.265172 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff83ca-854a-4d16-900b-d5db9b9d28a1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:27.286966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:27.329338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:27.330032 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:27.330317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:27.330595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] PATH_INFO: `/v3/projects/6d8feb42f01d4d278356ec1794da4056` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:27.331774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8feb42f01d4d278356ec1794da4056)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:27.333722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:27.381617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8feb42f01d4d278356ec1794da4056', 'request_id': 'req-24bd21b4-413e-4818-8f68-7371d177ac9c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.387746 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8feb42f01d4d278356ec1794da4056', 'request_id': 'req-24bd21b4-413e-4818-8f68-7371d177ac9c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.393692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8feb42f01d4d278356ec1794da4056', 'request_id': 'req-24bd21b4-413e-4818-8f68-7371d177ac9c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.407412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] The token cache is being invalidate because project 6d8feb42f01d4d278356ec1794da4056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:51:27.407831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.408502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:27.410451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1280/2568] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:51:27 2022] DELETE /identity/v3/projects/6d8feb42f01d4d278356ec1794da4056 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:37.074662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:37.403719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:45.495606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:45.496082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:45.496235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:45.517761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:45.518971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:45.577501 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1289/2569] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:51:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:45.589896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:45.591345 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:45.663460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd21b4-413e-4818-8f68-7371d177ac9c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:45.668973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac241d4-c2b2-48b5-b9a6-077a50ceab1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:45.669683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac241d4-c2b2-48b5-b9a6-077a50ceab1a service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:45.669894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac241d4-c2b2-48b5-b9a6-077a50ceab1a service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:45.670167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac241d4-c2b2-48b5-b9a6-077a50ceab1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:45.679025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac241d4-c2b2-48b5-b9a6-077a50ceab1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:45.680621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac241d4-c2b2-48b5-b9a6-077a50ceab1a service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:45.688712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1281/2570] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:51:55.176310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:55.178287 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:55.281622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278fb18-f738-4fb7-bebb-47b15b571f48 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:55.286486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:55.287248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:55.287539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:55.288303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] PATH_INFO: `/v3/users/072aff24ff9d4f5b91ede8e2e7ec7dd6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:55.289017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072aff24ff9d4f5b91ede8e2e7ec7dd6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:55.291154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:55.365478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072aff24ff9d4f5b91ede8e2e7ec7dd6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:55.374528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072aff24ff9d4f5b91ede8e2e7ec7dd6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:55.375284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072aff24ff9d4f5b91ede8e2e7ec7dd6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:55.375975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072aff24ff9d4f5b91ede8e2e7ec7dd6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:55.392284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072aff24ff9d4f5b91ede8e2e7ec7dd6'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:55.412214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1290/2571] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:51:55 2022] DELETE /identity/v3/users/072aff24ff9d4f5b91ede8e2e7ec7dd6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:55.416597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:55.417058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:55.417175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:55.439113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:55.440941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:55.511806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1282/2572] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:55.523768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:55.525489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:55.569392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:55.609341 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8094d2-2188-4238-8e0c-1a4c2a205cb6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:55.614646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479fd34-2b42-4d3a-8887-10da315ad529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:55.615930 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479fd34-2b42-4d3a-8887-10da315ad529 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:55.616214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479fd34-2b42-4d3a-8887-10da315ad529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:55.616491 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479fd34-2b42-4d3a-8887-10da315ad529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:55.628306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479fd34-2b42-4d3a-8887-10da315ad529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:55.628306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479fd34-2b42-4d3a-8887-10da315ad529 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:55.638476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1291/2573] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:51:55.968153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:55.970193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:55.984683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a29a2-c47c-477e-b895-ad083b50f14b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:55.990276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:55.990978 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:55.991262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:55.991541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] PATH_INFO: `/v3/projects/7c551c1c6ea74542b33f768205dab765` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:55.992713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c551c1c6ea74542b33f768205dab765)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:55.994667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.062362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c551c1c6ea74542b33f768205dab765', 'request_id': 'req-86b084e5-e349-46b9-ad57-3d0ed5a4356e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:56.070136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c551c1c6ea74542b33f768205dab765', 'request_id': 'req-86b084e5-e349-46b9-ad57-3d0ed5a4356e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:56.079823 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c551c1c6ea74542b33f768205dab765', 'request_id': 'req-86b084e5-e349-46b9-ad57-3d0ed5a4356e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:56.096502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] The token cache is being invalidate because project 7c551c1c6ea74542b33f768205dab765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:51:56.096919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:56.098051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-86b084e5-e349-46b9-ad57-3d0ed5a4356e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:51:56.102181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1283/2574] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:51:55 2022] DELETE /identity/v3/projects/7c551c1c6ea74542b33f768205dab765 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:51:56.106863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.107170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.107441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.132320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:56.133744 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:56.210321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1292/2575] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:56.216591 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.217089 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.217501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.241550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:56.242886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:56.251354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1284/2576] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:56.255935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.266277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdcec1-8ee5-4c53-b025-6a1a380b1558 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.271000 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.271640 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.271918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.272195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.273118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:51:56.273434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.275886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.293836 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1293/2577] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:51:56.295036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.305575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134fbe1-09ce-4bb9-a41c-64cf283bc07e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.310331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.310966 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.311248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.311523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.312194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.314157 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.319479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:56.351223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1285/2578] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:51:56 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:51:56.352303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.362819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867cb1f-4098-4272-8b54-952bba48b56f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.437923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.438566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.438851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.439128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.439822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.441914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.467878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1294/2579] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:51:56 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:51:56.475257 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.494652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d3218-1766-4453-aa6f-042ba35c525b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.507752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.514125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.514565 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.517051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.518018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.526349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.539005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1286/2580] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:51:56.542756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.553900 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2270d97-422d-469c-b3a4-caa61ad384ee admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.560100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6c097-2563-4ae8-a7b7-f6867b4c0d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.560738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c097-2563-4ae8-a7b7-f6867b4c0d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.561059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c097-2563-4ae8-a7b7-f6867b4c0d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.561338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c097-2563-4ae8-a7b7-f6867b4c0d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.562272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c097-2563-4ae8-a7b7-f6867b4c0d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.564084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6c097-2563-4ae8-a7b7-f6867b4c0d49 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.576907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1295/2581] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:51:56.580933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.602101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b267-db82-4e1a-a039-d11bffb071ed admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.607454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.608202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.608559 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.608910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] PATH_INFO: `/v3/projects/dcd689a426b64490a2c31023c91334a7/users/127d44e37edf4eccb85869ad5fcff9b0/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.625540 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd689a426b64490a2c31023c91334a7, user_id=127d44e37edf4eccb85869ad5fcff9b0, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.628237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.644478 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1287/2582] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:51:56 2022] PUT /identity/v3/projects/dcd689a426b64490a2c31023c91334a7/users/127d44e37edf4eccb85869ad5fcff9b0/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:51:56.659626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe8df-0f23-4d9e-a7a9-62b1a3fbde1d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.660061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe8df-0f23-4d9e-a7a9-62b1a3fbde1d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.660406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe8df-0f23-4d9e-a7a9-62b1a3fbde1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.698211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-257fe8df-0f23-4d9e-a7a9-62b1a3fbde1d None None] MFA Rules not processed for user `127d44e37edf4eccb85869ad5fcff9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:51:56.699645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-257fe8df-0f23-4d9e-a7a9-62b1a3fbde1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:56.722515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:56.777781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1296/2583] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:51:56.792050 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:51:56.793810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:51:56.884099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d1486-91a6-483c-ac5c-fd039a6a5161 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:51:56.888195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65ebd7-4ecc-4270-9f9d-5964f62735bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:51:56.888816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65ebd7-4ecc-4270-9f9d-5964f62735bc service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:51:56.889096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65ebd7-4ecc-4270-9f9d-5964f62735bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:51:56.889370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65ebd7-4ecc-4270-9f9d-5964f62735bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:51:56.899976 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65ebd7-4ecc-4270-9f9d-5964f62735bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:51:56.901535 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65ebd7-4ecc-4270-9f9d-5964f62735bc service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:51:56.914285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1288/2584] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:51:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:52:02.335646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2412af-7b49-48bd-b623-896fff96bf4c None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.336130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2412af-7b49-48bd-b623-896fff96bf4c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.336227 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2412af-7b49-48bd-b623-896fff96bf4c None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.337872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1297/2585] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:52:02.344407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bac17-07f2-42ec-b262-c4e811b4830e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.344875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bac17-07f2-42ec-b262-c4e811b4830e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.345895 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bac17-07f2-42ec-b262-c4e811b4830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.384091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3e4bac17-07f2-42ec-b262-c4e811b4830e None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:52:02.385405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e4bac17-07f2-42ec-b262-c4e811b4830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:02.475775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1289/2586] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:52:02.487143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2412af-7b49-48bd-b623-896fff96bf4c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:02.491088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2b2412af-7b49-48bd-b623-896fff96bf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:02.552910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2412af-7b49-48bd-b623-896fff96bf4c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:02.556506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb0e0-000c-4b29-ac76-7f2026aba5ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:02.557121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb0e0-000c-4b29-ac76-7f2026aba5ff service glance] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.557405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb0e0-000c-4b29-ac76-7f2026aba5ff service glance] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.557709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb0e0-000c-4b29-ac76-7f2026aba5ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.571750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb0e0-000c-4b29-ac76-7f2026aba5ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:02.571750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb0e0-000c-4b29-ac76-7f2026aba5ff service glance] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:02.581697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1298/2587] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:52:02.652443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc5e1-ebb5-46ed-abe8-8a48aeb53d2c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.652760 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc5e1-ebb5-46ed-abe8-8a48aeb53d2c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.653076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc5e1-ebb5-46ed-abe8-8a48aeb53d2c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.654479 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1290/2588] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:52:02.664007 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46c248-5ae9-49d0-8fec-094587d193ba None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.664300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46c248-5ae9-49d0-8fec-094587d193ba None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.667468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46c248-5ae9-49d0-8fec-094587d193ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.686352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4a46c248-5ae9-49d0-8fec-094587d193ba None None] MFA Rules not processed for user `56ea656c169243b9ac9319cb77bd4875`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:52:02.687591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4a46c248-5ae9-49d0-8fec-094587d193ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:02.741717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1299/2589] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:52:02.753796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc5e1-ebb5-46ed-abe8-8a48aeb53d2c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:02.756094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1c6dc5e1-ebb5-46ed-abe8-8a48aeb53d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:02.765125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:02.771278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc5e1-ebb5-46ed-abe8-8a48aeb53d2c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:02.775914 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dacb8f-f188-4abb-b0a7-bfd12e4a47e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:02.776854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dacb8f-f188-4abb-b0a7-bfd12e4a47e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.777141 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dacb8f-f188-4abb-b0a7-bfd12e4a47e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.778051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dacb8f-f188-4abb-b0a7-bfd12e4a47e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.787678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dacb8f-f188-4abb-b0a7-bfd12e4a47e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:02.789935 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dacb8f-f188-4abb-b0a7-bfd12e4a47e3 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:02.798892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1291/2590] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:52:02.888882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09a75-c0f3-441a-be9e-279a1d208a27 None None] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.889181 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09a75-c0f3-441a-be9e-279a1d208a27 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.889489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09a75-c0f3-441a-be9e-279a1d208a27 None None] PATH_INFO: `/` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.890916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1300/2591] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 29 04:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 29 04:52:02.896264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a863-380d-4ae1-afb8-d7712d5f7d71 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.896556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a863-380d-4ae1-afb8-d7712d5f7d71 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.896834 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a863-380d-4ae1-afb8-d7712d5f7d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.917671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7f31a863-380d-4ae1-afb8-d7712d5f7d71 None None] MFA Rules not processed for user `2919227b992743178d0128981ad54c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:52:02.918884 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f31a863-380d-4ae1-afb8-d7712d5f7d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:02.929115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1292/2592] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 29 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:52:02.939561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09a75-c0f3-441a-be9e-279a1d208a27 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:02.950543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09a75-c0f3-441a-be9e-279a1d208a27 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:02.954158 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:02.954760 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:02.955043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:02.955321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:02.965381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:02.966858 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:02.978043 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1301/2593] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:52:04.634496 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:04.634968 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:04.635068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:04.653907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:52:04.655107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:04.714227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1293/2594] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:52:04.726688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:04.728105 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:04.806381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:04.812695 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385f2d-4530-453b-878a-0decc6a6b078 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:04.834142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132642ce-8ab3-46ac-b522-526d3aeb85b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:04.834994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132642ce-8ab3-46ac-b522-526d3aeb85b1 service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:04.835353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132642ce-8ab3-46ac-b522-526d3aeb85b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:04.835888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132642ce-8ab3-46ac-b522-526d3aeb85b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:04.847951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132642ce-8ab3-46ac-b522-526d3aeb85b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:04.850584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132642ce-8ab3-46ac-b522-526d3aeb85b1 service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:04.864536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1302/2595] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:52:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 29 04:52:07.144836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:07.239431 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5d0be-82e3-4c78-b7d8-87b97b92d7b5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:07.244307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:07.244964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:07.245249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:07.245564 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] PATH_INFO: `/v3/users/127d44e37edf4eccb85869ad5fcff9b0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:07.246767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127d44e37edf4eccb85869ad5fcff9b0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:07.248756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:07.305189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127d44e37edf4eccb85869ad5fcff9b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.312907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127d44e37edf4eccb85869ad5fcff9b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.313722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127d44e37edf4eccb85869ad5fcff9b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.314772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127d44e37edf4eccb85869ad5fcff9b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.330185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127d44e37edf4eccb85869ad5fcff9b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.351132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1294/2596] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:52:07 2022] DELETE /identity/v3/users/127d44e37edf4eccb85869ad5fcff9b0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:52:07.355773 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:07.356279 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:07.356624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:07.376649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:52:07.377962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:07.441403 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1303/2597] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:52:07.447812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:07.449329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:07.462553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:07.513072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985ef5d-ec99-492e-8ddc-4d1466650ab8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:07.516631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50b45-dac2-4788-a37e-ce5a5e90b6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:07.517241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50b45-dac2-4788-a37e-ce5a5e90b6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:07.517529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50b45-dac2-4788-a37e-ce5a5e90b6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:07.517835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50b45-dac2-4788-a37e-ce5a5e90b6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:07.526876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50b45-dac2-4788-a37e-ce5a5e90b6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:07.528299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50b45-dac2-4788-a37e-ce5a5e90b6a5 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:07.538128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1295/2598] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:52:07.844602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:07.846312 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:07.861818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c3e0-3add-4ac5-9314-4845113402a4 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:07.868083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:07.868769 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:07.869042 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:07.869330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] PATH_INFO: `/v3/projects/dcd689a426b64490a2c31023c91334a7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:07.870635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd689a426b64490a2c31023c91334a7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:07.872579 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:07.940605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd689a426b64490a2c31023c91334a7', 'request_id': 'req-d080bb40-e8fb-4f98-ae53-e8a051594968'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.952162 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd689a426b64490a2c31023c91334a7', 'request_id': 'req-d080bb40-e8fb-4f98-ae53-e8a051594968'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.962369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd689a426b64490a2c31023c91334a7', 'request_id': 'req-d080bb40-e8fb-4f98-ae53-e8a051594968'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.975887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] The token cache is being invalidate because project dcd689a426b64490a2c31023c91334a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:52:07.976179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.976820 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:52:07.978361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1304/2599] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:52:07 2022] DELETE /identity/v3/projects/dcd689a426b64490a2c31023c91334a7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:52:17.533385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=22 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:17.972073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:24.649178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:24.649699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:24.649800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:24.668755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:52:24.669984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:24.730179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1296/2600] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 29 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:52:24.752050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:52:24.753449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:52:24.822454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080bb40-e8fb-4f98-ae53-e8a051594968 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:52:24.828120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:52:24.829030 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:52:24.829484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:52:24.830063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:52:24.838766 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:52:24.840350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:52:24.848827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1305/2601] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:52:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:52:34.718814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:34.845139 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=32 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:13.825973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:13.827398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:13.882878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ee745-8c0b-43f2-b0d7-7112bc0ee915 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:13.886501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:13.887108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:13.887388 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:13.887662 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:13.889584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:13.953720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:13.955169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:13.965518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1297/2602] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:17.145363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.146909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:17.161914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a35350-3b40-4959-99b7-f867f4b528dc service swift] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:17.167334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:17.167968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.168251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.168528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] PATH_INFO: `/v3/users/8990ee8f728f4dea9686b4819ee28fd7` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.182461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8990ee8f728f4dea9686b4819ee28fd7)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:17.184382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:17.234277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8990ee8f728f4dea9686b4819ee28fd7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.240970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8990ee8f728f4dea9686b4819ee28fd7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.241679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8990ee8f728f4dea9686b4819ee28fd7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.242333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8990ee8f728f4dea9686b4819ee28fd7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.254135 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-2ccc9a1a-c8ee-408c-adc3-364961de54a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8990ee8f728f4dea9686b4819ee28fd7'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.267261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1306/2603] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:17 2022] DELETE /identity/v3/users/8990ee8f728f4dea9686b4819ee28fd7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:17.452525 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.462669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334d1a-1826-47ba-8d03-4f58dabea165 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:17.521533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:17.522133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.522419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.522699 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] PATH_INFO: `/v3/projects/0b01c97a73084744bcbb93e334a14536` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.533447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b01c97a73084744bcbb93e334a14536)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:17.535519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:17.577387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:17.581423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b01c97a73084744bcbb93e334a14536', 'request_id': 'req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.588283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b01c97a73084744bcbb93e334a14536', 'request_id': 'req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.593768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b01c97a73084744bcbb93e334a14536', 'request_id': 'req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.605984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] The token cache is being invalidate because project 0b01c97a73084744bcbb93e334a14536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:17.606268 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.606891 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4ba4d56b-55a9-432c-b1ad-d02a8a06a2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:17.608393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1298/2604] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:17 2022] DELETE /identity/v3/projects/0b01c97a73084744bcbb93e334a14536 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:17.613318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.613647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.613936 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.644081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:17.645309 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:17.709140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1307/2605] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:53:17.717972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.718265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.718558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.739067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:17.740329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:17.753158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1299/2606] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:17.757685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.767356 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf877c1-d375-4007-ac87-24435b4ba543 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:17.772045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:17.772592 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.772881 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.773155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.774029 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:17.774340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:17.776063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:17.788648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1308/2607] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:53:17.793721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.803568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779022c4-40af-462b-bbb3-e89b0797ea84 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:17.808942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:17.809555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.809967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.810240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.810924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:17.812814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:17.851099 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1300/2608] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:17 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:53:17.855916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.866097 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eb4e5-12e6-47b9-9e21-9f10a622837f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:17.909461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:17.923683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:17.924324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.924609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.924887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.925554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:17.927840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:17.949578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1309/2609] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:17 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:17.953743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.963851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16935bd4-560d-4660-8998-c35ae99d8aee admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:17.968354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:17.968950 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:17.969229 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:17.969502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:17.970219 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:17.971797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:17.981942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1301/2610] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:17.986469 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:17.996852 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cfb38-92f1-44cd-9918-95e742b30192 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.001395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd152-7e39-4cbe-977d-f32ded280978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.002033 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd152-7e39-4cbe-977d-f32ded280978 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.002315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd152-7e39-4cbe-977d-f32ded280978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.002584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd152-7e39-4cbe-977d-f32ded280978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.003257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bd152-7e39-4cbe-977d-f32ded280978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.004830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bd152-7e39-4cbe-977d-f32ded280978 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.016092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1310/2611] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:18.020213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.030264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d42c18-eab8-4ccd-920b-477a5516bf93 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.034773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.035419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.035709 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.035991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] PATH_INFO: `/v3/projects/1298d2f3cc464d209bad200173f9c364/users/18903bdcd5b4489d92d47fe5bed196ec/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.052399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1298d2f3cc464d209bad200173f9c364, user_id=18903bdcd5b4489d92d47fe5bed196ec, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.055729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.068181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1302/2612] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:18 2022] PUT /identity/v3/projects/1298d2f3cc464d209bad200173f9c364/users/18903bdcd5b4489d92d47fe5bed196ec/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:18.078535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dff4cb-2573-4450-a800-fde38740302b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.078825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dff4cb-2573-4450-a800-fde38740302b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.079103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dff4cb-2573-4450-a800-fde38740302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.107058 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-19dff4cb-2573-4450-a800-fde38740302b None None] MFA Rules not processed for user `18903bdcd5b4489d92d47fe5bed196ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:18.108264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-19dff4cb-2573-4450-a800-fde38740302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:18.171545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1311/2613] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:18.176338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.236799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7df22-0b11-44b3-91a7-b818f440c884 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.241523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.242171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.242450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.242722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.243379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.245321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.270995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1303/2614] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:18 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:18.275670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dff4cb-2573-4450-a800-fde38740302b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.286188 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dff4cb-2573-4450-a800-fde38740302b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.341536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.342218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.342508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.342788 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.343458 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.345416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.366824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1312/2615] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:18 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:18.370926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.381017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc672e-3eef-46de-85b8-fded4887d2c3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.385553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.386173 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.386452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.386721 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.387396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.389001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.399598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1304/2616] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:18.403507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.413486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8756cb-1442-4310-8f6c-da99d4e42209 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.419065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.419717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.420010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.420322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] PATH_INFO: `/v3/projects/3e27524144704c42820c3848098ae7a8/users/337d50511e6d4e118b1520abd6c97031/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.434969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e27524144704c42820c3848098ae7a8, user_id=337d50511e6d4e118b1520abd6c97031, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.437783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.451256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1313/2617] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:18 2022] PUT /identity/v3/projects/3e27524144704c42820c3848098ae7a8/users/337d50511e6d4e118b1520abd6c97031/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:18.455249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.465924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70140a-30cd-4e15-80a0-38e4c4c6027c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.496488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:18.525344 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5081c96-9bb0-45bd-86c1-1a91f45f0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.526061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5081c96-9bb0-45bd-86c1-1a91f45f0776 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.526347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5081c96-9bb0-45bd-86c1-1a91f45f0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.526625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5081c96-9bb0-45bd-86c1-1a91f45f0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.527310 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5081c96-9bb0-45bd-86c1-1a91f45f0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.528910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5081c96-9bb0-45bd-86c1-1a91f45f0776 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.538521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1305/2618] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:18.542663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.553035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206096e-6ff6-466a-87f8-92f0ca0ad257 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.557809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.558472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.558754 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.559027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] PATH_INFO: `/v3/projects/3e27524144704c42820c3848098ae7a8/users/337d50511e6d4e118b1520abd6c97031/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.561004 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e27524144704c42820c3848098ae7a8, user_id=337d50511e6d4e118b1520abd6c97031, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.563770 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.574434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1314/2619] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:18 2022] PUT /identity/v3/projects/3e27524144704c42820c3848098ae7a8/users/337d50511e6d4e118b1520abd6c97031/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:18.586339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.586630 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.586906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.613273 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] MFA Rules not processed for user `337d50511e6d4e118b1520abd6c97031`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:18.614533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:18.683464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1306/2620] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:18.694767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:18.696980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:18.707892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:18.754271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f4a4-f4b6-46ce-9890-c5188ce2f339 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:18.758367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:18.758965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:18.759242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:18.759625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:18.815364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:18.816709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:18.825850 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1315/2621] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:20.176921 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:20.178410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:20.191070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e643bf-47e5-4fe4-8407-cd3e65de415f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:20.194592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5fbfb-a8a4-4b92-8a08-07765c7823ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:20.195217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5fbfb-a8a4-4b92-8a08-07765c7823ee service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:20.195500 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5fbfb-a8a4-4b92-8a08-07765c7823ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:20.195776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5fbfb-a8a4-4b92-8a08-07765c7823ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:20.204590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5fbfb-a8a4-4b92-8a08-07765c7823ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:20.206049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5fbfb-a8a4-4b92-8a08-07765c7823ee service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:20.215416 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1307/2622] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:23.975336 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:24.044277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de391a7-20a2-4c6c-a232-d97c2e4a4474 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:24.048761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:24.049389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:24.049698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:24.049970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] PATH_INFO: `/v3/users/18903bdcd5b4489d92d47fe5bed196ec` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:24.051372 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18903bdcd5b4489d92d47fe5bed196ec)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:24.053270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:24.097174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18903bdcd5b4489d92d47fe5bed196ec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.104803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18903bdcd5b4489d92d47fe5bed196ec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.105479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18903bdcd5b4489d92d47fe5bed196ec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.106121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18903bdcd5b4489d92d47fe5bed196ec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.113155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:24.119828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18903bdcd5b4489d92d47fe5bed196ec'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.131942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1316/2623] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:23 2022] DELETE /identity/v3/users/18903bdcd5b4489d92d47fe5bed196ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:24.136654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1994-1741-468e-884b-076a8316701e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:24.137136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1994-1741-468e-884b-076a8316701e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:24.137331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1994-1741-468e-884b-076a8316701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:24.156576 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3dad1994-1741-468e-884b-076a8316701e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:24.157812 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3dad1994-1741-468e-884b-076a8316701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:24.215509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1308/2624] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:24.225177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:24.227246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:24.282192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9ee3-2237-4f41-9e60-56a071c07e81 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:24.285824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:24.286432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:24.286717 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:24.286993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:24.296846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:24.298249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:24.307897 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1317/2625] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:24.580789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1994-1741-468e-884b-076a8316701e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:24.582241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3dad1994-1741-468e-884b-076a8316701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:24.594912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1994-1741-468e-884b-076a8316701e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:24.599588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:24.600232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:24.600516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:24.600800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] PATH_INFO: `/v3/projects/1298d2f3cc464d209bad200173f9c364` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:24.602033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1298d2f3cc464d209bad200173f9c364)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:24.603955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:24.642402 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:24.653070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1298d2f3cc464d209bad200173f9c364', 'request_id': 'req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.659198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1298d2f3cc464d209bad200173f9c364', 'request_id': 'req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.664904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1298d2f3cc464d209bad200173f9c364', 'request_id': 'req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.677198 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] The token cache is being invalidate because project 1298d2f3cc464d209bad200173f9c364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:24.677489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.678149 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.679743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1309/2626] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:24 2022] DELETE /identity/v3/projects/1298d2f3cc464d209bad200173f9c364 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:24.683767 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:24.693477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5df9bc-22e1-4062-a02e-0b1f0d9aa9dc service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:24.749822 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:24.750453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:24.750732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:24.751002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] PATH_INFO: `/v3/users/337d50511e6d4e118b1520abd6c97031` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:24.752142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337d50511e6d4e118b1520abd6c97031)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:24.754068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:24.800366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337d50511e6d4e118b1520abd6c97031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.807305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337d50511e6d4e118b1520abd6c97031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.807955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337d50511e6d4e118b1520abd6c97031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.808558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337d50511e6d4e118b1520abd6c97031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.820493 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e468bc10-d8fc-466b-aaed-4c0bd06bb758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337d50511e6d4e118b1520abd6c97031'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:24.832983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1318/2627] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:24 2022] DELETE /identity/v3/users/337d50511e6d4e118b1520abd6c97031 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:25.105990 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.107567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:25.120801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88a8ff-bf2f-486d-bd08-0f514450ce3c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.179444 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.180107 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.180357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.180636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] PATH_INFO: `/v3/projects/3e27524144704c42820c3848098ae7a8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.181820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e27524144704c42820c3848098ae7a8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.183726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.229232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e27524144704c42820c3848098ae7a8', 'request_id': 'req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:25.235550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e27524144704c42820c3848098ae7a8', 'request_id': 'req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:25.240937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e27524144704c42820c3848098ae7a8', 'request_id': 'req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:25.252743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] The token cache is being invalidate because project 3e27524144704c42820c3848098ae7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:25.253021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:25.253698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ea5418fd-623e-4f66-aaf7-5dbbbfcfaef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:25.255218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1310/2628] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:25 2022] DELETE /identity/v3/projects/3e27524144704c42820c3848098ae7a8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:25.261008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.261742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.261742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.271031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:25.282916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:25.284125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:25.341573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1319/2629] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:53:25.349358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.349585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.349885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.369862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:25.371080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:25.379638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1311/2630] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:25.384460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.394050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5b0c2-cce0-4075-a84d-2d62f7a5374d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.399156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.399753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.400034 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.400305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.400990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:25.401292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.402903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.414036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1320/2631] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:53:25.418266 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.427800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c7c3a-3496-4fa1-b552-573e2193d81e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.432464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.433067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.433353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.433661 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.434339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.436239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.465061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1312/2632] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:25.470001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.479838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1135d77-7d24-490c-85dd-e2fd26a30ffc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.535111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.535731 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.536015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.536351 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.537015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.538940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.558830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1321/2633] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:25.563865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.575022 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9806a-d3cd-4de3-8292-891eb08fd548 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.579844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.580446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.580732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.581007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.581730 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.583329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.593809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1313/2634] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:25.597830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.607625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19989ca-2b65-432b-af65-7189cdd1958d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.612082 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e48a1-332f-4db4-8385-0d1782066d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.612670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e48a1-332f-4db4-8385-0d1782066d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.612950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e48a1-332f-4db4-8385-0d1782066d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.613223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e48a1-332f-4db4-8385-0d1782066d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.613944 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e48a1-332f-4db4-8385-0d1782066d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.615508 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e48a1-332f-4db4-8385-0d1782066d87 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.626393 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1322/2635] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:25.630458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.640998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fac42b-108f-405b-b8ba-3c5f31ab8ac5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.645767 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.646394 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.646676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.646951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] PATH_INFO: `/v3/projects/5fb552030ade4023abe4e4b53897cb7d/users/5ec21e8e78654a03ac78fd8cb5ebc0a5/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.658922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:25.662185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb552030ade4023abe4e4b53897cb7d, user_id=5ec21e8e78654a03ac78fd8cb5ebc0a5, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.665272 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.678434 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1314/2636] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:25 2022] PUT /identity/v3/projects/5fb552030ade4023abe4e4b53897cb7d/users/5ec21e8e78654a03ac78fd8cb5ebc0a5/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:25.689163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.689450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.689762 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.717119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] MFA Rules not processed for user `5ec21e8e78654a03ac78fd8cb5ebc0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:25.718422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:25.778103 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:25.782189 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1323/2637] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:25.786873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.847901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869fb1-d178-44f7-8d84-902630c77c10 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.853151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.853800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.854091 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.854371 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.855164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.857064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.883883 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1315/2638] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:53:25.888059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.899305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8249744-8674-46a9-a2db-3cc654567a95 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:25.957824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:25.958450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:25.958738 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:25.959017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:25.959679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:25.962143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:25.983045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1324/2639] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:25 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:25.987022 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:25.997385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3b4d7-9072-400a-87e3-d4de7ecf81b0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:26.001970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:26.002574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.002858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.003136 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.003826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:26.005408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:26.016202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1316/2640] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:26.020243 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:26.030673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54819a-ef05-4038-ba63-a73840ef27df admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:26.035208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:26.035849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.036131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.036450 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] PATH_INFO: `/v3/projects/462f944988db43deab7df34437b239c1/users/dfb6ffca20304401b38d109f7556bd5d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.050720 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462f944988db43deab7df34437b239c1, user_id=dfb6ffca20304401b38d109f7556bd5d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:26.053611 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:26.065889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1325/2641] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:26 2022] PUT /identity/v3/projects/462f944988db43deab7df34437b239c1/users/dfb6ffca20304401b38d109f7556bd5d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:26.069700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:26.079859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd442a6-ec1d-419d-8aa8-f2679186a615 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:26.134460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ab0a2-5066-443c-a5a7-757c87fb5fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:26.134999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab0a2-5066-443c-a5a7-757c87fb5fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.135294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab0a2-5066-443c-a5a7-757c87fb5fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.135568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab0a2-5066-443c-a5a7-757c87fb5fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.136254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab0a2-5066-443c-a5a7-757c87fb5fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:26.138233 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab0a2-5066-443c-a5a7-757c87fb5fe8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:26.147747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1317/2642] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:26.152391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:26.162510 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abb0cd-7014-4525-a3b5-b368c75ae4b2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:26.167035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:26.167686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.167967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.168246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] PATH_INFO: `/v3/projects/462f944988db43deab7df34437b239c1/users/dfb6ffca20304401b38d109f7556bd5d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.170196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=462f944988db43deab7df34437b239c1, user_id=dfb6ffca20304401b38d109f7556bd5d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:26.172805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:26.182989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1326/2643] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:26 2022] PUT /identity/v3/projects/462f944988db43deab7df34437b239c1/users/dfb6ffca20304401b38d109f7556bd5d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:26.193925 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.194408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.194505 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.222284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] MFA Rules not processed for user `dfb6ffca20304401b38d109f7556bd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:26.223492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:26.269789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:26.291703 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1318/2644] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:26.302521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:26.304214 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:26.359338 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2fa0-fba7-424e-934a-25aed0a4fa5e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:26.362907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:26.363505 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.363784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.364059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.373196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:26.374643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:26.384299 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1327/2645] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:26.484466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:26.494508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050953b-9580-47a3-829d-48e8dd1d0b14 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:26.498054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f5bb2-44e3-4925-b051-87c997fe9801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:26.498650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5bb2-44e3-4925-b051-87c997fe9801 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:26.498929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5bb2-44e3-4925-b051-87c997fe9801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:26.499200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5bb2-44e3-4925-b051-87c997fe9801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:26.555787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f5bb2-44e3-4925-b051-87c997fe9801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:26.557255 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f5bb2-44e3-4925-b051-87c997fe9801 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:26.566213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1319/2646] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:29.164604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:29.220903 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:29.227539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95898b-8947-46ff-8f49-712801eead72 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:29.233363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:29.234119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:29.234404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:29.234687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] PATH_INFO: `/v3/users/5ec21e8e78654a03ac78fd8cb5ebc0a5` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:29.235892 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec21e8e78654a03ac78fd8cb5ebc0a5)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:29.237908 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:29.290382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec21e8e78654a03ac78fd8cb5ebc0a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.297674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec21e8e78654a03ac78fd8cb5ebc0a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.298389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec21e8e78654a03ac78fd8cb5ebc0a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.298989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec21e8e78654a03ac78fd8cb5ebc0a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.312271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec21e8e78654a03ac78fd8cb5ebc0a5'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.326711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1328/2647] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:29 2022] DELETE /identity/v3/users/5ec21e8e78654a03ac78fd8cb5ebc0a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:29.331243 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:29.331749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:29.332072 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:29.353276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:29.354528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:29.417307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1320/2648] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:29.427886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:29.429625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:29.489389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71ba0-8b5a-488c-8386-085b0e51e44d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:29.490529 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:29.491917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:29.493249 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:29.493896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:29.494183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:29.494461 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:29.503630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:29.503795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403845f-55db-4ab1-b0b2-86ec4e68d75e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:29.505052 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:29.507457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:29.508181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:29.508464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:29.508744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:29.510519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:29.515060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1329/2649] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:29.587290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:29.588736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:29.600814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1321/2650] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:29.791917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:29.793379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:29.807203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa9809-b893-4b4e-a0f4-dde3856de969 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:29.811926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:29.812646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:29.813119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:29.813566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] PATH_INFO: `/v3/projects/5fb552030ade4023abe4e4b53897cb7d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:29.814764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb552030ade4023abe4e4b53897cb7d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:29.816654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:29.867534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb552030ade4023abe4e4b53897cb7d', 'request_id': 'req-cc0fbab4-50c3-4371-80ee-228ab73387e3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.873725 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb552030ade4023abe4e4b53897cb7d', 'request_id': 'req-cc0fbab4-50c3-4371-80ee-228ab73387e3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.879376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb552030ade4023abe4e4b53897cb7d', 'request_id': 'req-cc0fbab4-50c3-4371-80ee-228ab73387e3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.889250 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:29.893330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] The token cache is being invalidate because project 5fb552030ade4023abe4e4b53897cb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:29.893840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.894971 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:29.896645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1330/2651] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:29 2022] DELETE /identity/v3/projects/5fb552030ade4023abe4e4b53897cb7d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:29.901231 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:29.911633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb65a-2cd5-4d45-b24b-174ddeb48d00 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:29.919462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:29.969972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:29.970610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:29.970896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:29.971175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] PATH_INFO: `/v3/users/dfb6ffca20304401b38d109f7556bd5d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:29.972342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb6ffca20304401b38d109f7556bd5d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:29.974318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.020331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb6ffca20304401b38d109f7556bd5d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.027694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb6ffca20304401b38d109f7556bd5d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.028351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb6ffca20304401b38d109f7556bd5d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.028973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb6ffca20304401b38d109f7556bd5d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.040636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-132017c6-ef86-456c-83d5-325c1d8fd924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb6ffca20304401b38d109f7556bd5d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.053451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1322/2652] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:29 2022] DELETE /identity/v3/users/dfb6ffca20304401b38d109f7556bd5d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:30.327928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.329390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:30.352364 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fbab4-50c3-4371-80ee-228ab73387e3 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.409419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.410088 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.410381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.410659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] PATH_INFO: `/v3/projects/462f944988db43deab7df34437b239c1` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.411819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462f944988db43deab7df34437b239c1)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.413748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.461066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462f944988db43deab7df34437b239c1', 'request_id': 'req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.467136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462f944988db43deab7df34437b239c1', 'request_id': 'req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.472699 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462f944988db43deab7df34437b239c1', 'request_id': 'req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.485511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] The token cache is being invalidate because project 462f944988db43deab7df34437b239c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:30.486331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.486959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7d2f5555-5658-4c9b-b7b3-0e04671f4c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:30.488490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1331/2653] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:30 2022] DELETE /identity/v3/projects/462f944988db43deab7df34437b239c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:30.493953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.494364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.494514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.513492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:30.514741 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:30.572995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1323/2654] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:30.580772 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.581059 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.581332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.600663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:30.602415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:30.610123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1332/2655] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:30.614164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.624511 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87639eda-5d86-457e-81a2-9c86330af0bb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.629061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.629698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.629984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.630263 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.630951 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:30.631283 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.632906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.644287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1324/2656] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:53:30.648529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.657795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a394-0dfe-4a6b-b334-de05db21bc33 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.662464 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.663066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.663352 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.664166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.664901 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.666829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.694286 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1333/2657] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:53:30.698382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.708364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d06302-2d87-485e-8107-0915578ba04f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.720447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:30.768560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.769176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.769457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.769776 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.770433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.772346 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.793827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.795521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:30.798555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1325/2658] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:30 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:30.799415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.809652 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343a5c-de1d-4838-b786-c9683ad3c094 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.814358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.814969 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.815256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.815534 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.816223 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.817852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.828708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1326/2659] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:30.832678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.843317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472447-6aeb-41c9-a964-94e9c1d06f33 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.848161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.848761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.849052 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.849333 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.850058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.851642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.854365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89d64-4385-4f74-9110-53ab93fc76c9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.858063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.858691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.858973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.859251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.861132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:30.861689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1327/2660] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:30.865747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:30.875875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33cff3-dae1-4594-aaaf-5f08b5b6b13a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:30.876242 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:30.880957 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65422-d5c5-49af-9f73-2a0aebf2e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:30.881963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65422-d5c5-49af-9f73-2a0aebf2e457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.882094 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65422-d5c5-49af-9f73-2a0aebf2e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.882922 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65422-d5c5-49af-9f73-2a0aebf2e457 admin admin] PATH_INFO: `/v3/projects/0fca7c18bc86429cb05c3b46aaf717ab/users/f4657bea244e44919680146dd1930bdc/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.897865 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65422-d5c5-49af-9f73-2a0aebf2e457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fca7c18bc86429cb05c3b46aaf717ab, user_id=f4657bea244e44919680146dd1930bdc, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.900620 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65422-d5c5-49af-9f73-2a0aebf2e457 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.913657 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1328/2661] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:30 2022] PUT /identity/v3/projects/0fca7c18bc86429cb05c3b46aaf717ab/users/f4657bea244e44919680146dd1930bdc/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:30.923979 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:30.924166 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:30.924407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:30.946448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:30.948072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:30.958414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] MFA Rules not processed for user `f4657bea244e44919680146dd1930bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:30.959671 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:30.960540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1334/2662] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:53:31.030097 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1329/2663] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:53:31.039353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:31.049605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:31.107833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c51f7-607a-47a3-84fd-0258efa39e30 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:31.156407 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:31.157026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:31.157313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:31.157620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:31.165985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:31.167412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:31.176433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1335/2664] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:36.344860 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:36.398550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143b43-3822-46a9-aaa1-3bafc2c77d61 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:36.402144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:36.402752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:36.403039 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:36.403314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:36.405092 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:36.410125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:36.469547 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:36.470993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e713a-50ca-4b35-967c-a6209583e6d9 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:36.481386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1330/2665] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:36.543296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:36.555218 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eee4f-414e-419a-901f-994d83ffba90 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:36.559753 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:36.560384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:36.560670 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:36.560950 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] PATH_INFO: `/v3/users/f4657bea244e44919680146dd1930bdc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:36.562145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4657bea244e44919680146dd1930bdc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:36.564077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:36.615110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4657bea244e44919680146dd1930bdc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:36.621940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4657bea244e44919680146dd1930bdc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:36.622600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4657bea244e44919680146dd1930bdc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:36.623221 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4657bea244e44919680146dd1930bdc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:36.624327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:36.636477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4657bea244e44919680146dd1930bdc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:36.650260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1336/2666] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:36 2022] DELETE /identity/v3/users/f4657bea244e44919680146dd1930bdc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:36.654668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:36.654956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:36.655234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:36.673937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:36.675130 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:36.734386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1331/2667] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:36.744093 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:36.745560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:36.806869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451e2af-263d-44be-b4f7-8df6ff796b41 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:36.812397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cf41-0c31-4c86-b24f-18b73aedb7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:36.813023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cf41-0c31-4c86-b24f-18b73aedb7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:36.813360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cf41-0c31-4c86-b24f-18b73aedb7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:36.813879 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cf41-0c31-4c86-b24f-18b73aedb7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:36.824247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cf41-0c31-4c86-b24f-18b73aedb7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:36.825714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cf41-0c31-4c86-b24f-18b73aedb7eb service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:36.835331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1337/2668] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:37.262674 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.264086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:37.275853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164e53-fc63-49de-bc29-434bc11dbcb3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.280393 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.281031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.281289 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.281561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] PATH_INFO: `/v3/projects/0fca7c18bc86429cb05c3b46aaf717ab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.285624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fca7c18bc86429cb05c3b46aaf717ab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.285624 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.337341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fca7c18bc86429cb05c3b46aaf717ab', 'request_id': 'req-5c2ed973-1191-47aa-be8f-6479ce5b675c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:37.343592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fca7c18bc86429cb05c3b46aaf717ab', 'request_id': 'req-5c2ed973-1191-47aa-be8f-6479ce5b675c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:37.349284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fca7c18bc86429cb05c3b46aaf717ab', 'request_id': 'req-5c2ed973-1191-47aa-be8f-6479ce5b675c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:37.365244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] The token cache is being invalidate because project 0fca7c18bc86429cb05c3b46aaf717ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:37.365590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:37.366230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5c2ed973-1191-47aa-be8f-6479ce5b675c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:37.368432 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1332/2669] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:37 2022] DELETE /identity/v3/projects/0fca7c18bc86429cb05c3b46aaf717ab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:37.373314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.373620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.373993 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.393198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:37.394438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:37.464120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1338/2670] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:37.471956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.472245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.472520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.494983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:37.496227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:37.504858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1333/2671] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:37.509276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.519792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b14619-6a02-4df7-ab16-886469a4d27d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.524616 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.525256 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.525538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.525843 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.526549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:37.526855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.528452 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.542567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1339/2672] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:53:37.546578 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.557003 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef5b5-3439-4ddb-aad9-7bdd0f6da909 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.563256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.564060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.564439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.564805 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.565577 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.567809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.585235 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:37.603619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1334/2673] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:37 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:37.607067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.617552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01956bb-7108-46e0-a723-0a7b88fec941 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.680554 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.681292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.681736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.682346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.682690 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.684673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.695374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:37.709890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1340/2674] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:37 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:37.714648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.725024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859531a-32e2-470e-9583-b1862d96f4a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.730408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.731019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.731298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.731572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.732265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.733894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.748106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1335/2675] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:37.749203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.765677 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1468-aa58-4d95-8b78-c467280ca5fc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.766582 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c27b1-d3ce-45ff-bc2f-5fb30799b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.767316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c27b1-d3ce-45ff-bc2f-5fb30799b8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.767931 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c27b1-d3ce-45ff-bc2f-5fb30799b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.768335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c27b1-d3ce-45ff-bc2f-5fb30799b8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.769151 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c27b1-d3ce-45ff-bc2f-5fb30799b8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.770956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c27b1-d3ce-45ff-bc2f-5fb30799b8e2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.784230 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1341/2676] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:37.788090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:37.800903 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fa712-ee06-4542-8362-34f809b951aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:37.806025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:37.806710 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.807021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.807316 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] PATH_INFO: `/v3/projects/ae53a0ef1ed14a34bc6e66536d09d9f6/users/168aed3299e64426a4e9ca8b6f89f733/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.823328 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae53a0ef1ed14a34bc6e66536d09d9f6, user_id=168aed3299e64426a4e9ca8b6f89f733, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:37.826048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:37.840351 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1336/2677] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:37 2022] PUT /identity/v3/projects/ae53a0ef1ed14a34bc6e66536d09d9f6/users/168aed3299e64426a4e9ca8b6f89f733/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:37.852084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:37.852378 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:37.852662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:37.883650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] MFA Rules not processed for user `168aed3299e64426a4e9ca8b6f89f733`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:37.884816 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:37.958562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1342/2678] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:37.963698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.027806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b1e00-7a07-45ae-aa81-69fb737ff6e2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.032439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.033057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.033343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.033649 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.034315 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.036214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.062850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1337/2679] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:37 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:38.067046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.078674 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49947bc-60e7-4bf0-ab32-51881133a00e None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.134383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.134928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.135210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.135488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.136170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.138120 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.159779 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1343/2680] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:38 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:38.163836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.174002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70702-8b6e-46e6-8c6b-8e0355861ee2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.179481 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.180232 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.180608 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.181016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.181848 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.183472 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.196271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1338/2681] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:38.200468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.211888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d529e-9676-4171-97c0-58ba17f2f682 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.216740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.217479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.217865 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.218217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] PATH_INFO: `/v3/projects/3aa252f921e249738c2b2b03442c821f/users/8e70009480964e958b528f3a723d7419/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.235222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa252f921e249738c2b2b03442c821f, user_id=8e70009480964e958b528f3a723d7419, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.238062 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.255863 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1344/2682] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:38 2022] PUT /identity/v3/projects/3aa252f921e249738c2b2b03442c821f/users/8e70009480964e958b528f3a723d7419/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:38.257010 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.267780 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c914f80-2e8d-4d33-90fc-f4eea893c454 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.330548 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be02b9-8a77-4925-936c-b746d155983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.331177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be02b9-8a77-4925-936c-b746d155983b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.331590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be02b9-8a77-4925-936c-b746d155983b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.331882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be02b9-8a77-4925-936c-b746d155983b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.332580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be02b9-8a77-4925-936c-b746d155983b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.334405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be02b9-8a77-4925-936c-b746d155983b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.351114 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1339/2683] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:38.352282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.363257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a952e3-e7aa-4ce3-8740-537cd3cc6b1a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.368962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.369652 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.369942 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.370337 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] PATH_INFO: `/v3/projects/3aa252f921e249738c2b2b03442c821f/users/8e70009480964e958b528f3a723d7419/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.372924 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa252f921e249738c2b2b03442c821f, user_id=8e70009480964e958b528f3a723d7419, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.376752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.388941 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1345/2684] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:38 2022] PUT /identity/v3/projects/3aa252f921e249738c2b2b03442c821f/users/8e70009480964e958b528f3a723d7419/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:38.400342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.400668 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.400909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.433803 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] MFA Rules not processed for user `8e70009480964e958b528f3a723d7419`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:38.435030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:38.457881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:38.517942 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1340/2685] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:38.529289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:38.531144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:38.567247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:38.603024 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298f60-049d-4634-895b-fa46499c1caf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:38.607130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:38.607734 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:38.608022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:38.608293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:38.670509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:38.671970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:38.683155 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1346/2686] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:53:39.842572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:39.844956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:39.923656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab4f21-0044-4caa-8261-bd409de27af6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:39.929658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:39.929658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:39.929928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:39.930196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] PATH_INFO: `/v3/users/3cf68e097d3941218efae9a5ef5bba12` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:39.943729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf68e097d3941218efae9a5ef5bba12)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:39.947195 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:39.992132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf68e097d3941218efae9a5ef5bba12'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:39.999516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf68e097d3941218efae9a5ef5bba12'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.000153 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf68e097d3941218efae9a5ef5bba12'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.000747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf68e097d3941218efae9a5ef5bba12'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.012923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4e1ee15f-afad-4ec9-91a9-8fa413bcbdb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf68e097d3941218efae9a5ef5bba12'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.025588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1341/2687] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:39 2022] DELETE /identity/v3/users/3cf68e097d3941218efae9a5ef5bba12 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:40.219660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.231740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b40b9a-77c1-4f6e-aa61-2af1747c47fe service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.297445 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.298118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.298405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.298709 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] PATH_INFO: `/v3/projects/1eefa33951d84d969cf7174b1622724b` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.311198 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eefa33951d84d969cf7174b1622724b)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.313423 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.360443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eefa33951d84d969cf7174b1622724b', 'request_id': 'req-0222c80e-6eaa-48c9-97d4-3c56c27bd306'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.368031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eefa33951d84d969cf7174b1622724b', 'request_id': 'req-0222c80e-6eaa-48c9-97d4-3c56c27bd306'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.373465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eefa33951d84d969cf7174b1622724b', 'request_id': 'req-0222c80e-6eaa-48c9-97d4-3c56c27bd306'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.381845 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:40.386502 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] The token cache is being invalidate because project 1eefa33951d84d969cf7174b1622724b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:40.387074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.388210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-0222c80e-6eaa-48c9-97d4-3c56c27bd306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:40.389966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1347/2688] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:40 2022] DELETE /identity/v3/projects/1eefa33951d84d969cf7174b1622724b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:40.394817 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb17e-97a4-4841-943b-634553908a20 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.395138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb17e-97a4-4841-943b-634553908a20 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.395414 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb17e-97a4-4841-943b-634553908a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.416122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-190bb17e-97a4-4841-943b-634553908a20 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:40.417401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-190bb17e-97a4-4841-943b-634553908a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:40.437191 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:40.603216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1342/2689] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:53:40.611080 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.611363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.611634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.630381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:40.631598 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:40.639559 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1348/2690] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:40.643568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb17e-97a4-4841-943b-634553908a20 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.653537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb17e-97a4-4841-943b-634553908a20 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.658021 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.658616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.658894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.659165 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.659871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:40.660186 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.661786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.673811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1343/2691] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:53:40.678145 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.687323 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86285514-a864-44e0-bed0-abded97f67e8 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.692123 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.692809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.693101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.693380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.694084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.695992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.722765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1349/2692] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:40 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:40.727567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.738148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a4da-26a1-448c-8082-eff1195d1ddd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.794946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.795562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.795844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.796117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.796784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.798735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.818983 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1344/2693] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:40 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:40.823211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.833480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bf9b3-a342-4ba7-ab99-f0f159dd1e06 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.838710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.839314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.839597 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.839870 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.840556 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.842180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.852636 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1350/2694] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:40.856700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.866756 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a01970-73ce-4fe4-af86-6d6ba6c8bc2a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.871293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9b2c-8711-4556-a0e8-2e56d7975439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.871897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9b2c-8711-4556-a0e8-2e56d7975439 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.872178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9b2c-8711-4556-a0e8-2e56d7975439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.872454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9b2c-8711-4556-a0e8-2e56d7975439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.873140 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9b2c-8711-4556-a0e8-2e56d7975439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.874791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9b2c-8711-4556-a0e8-2e56d7975439 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.884893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1345/2695] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:40.888902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:40.899515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfab6d-6486-4a08-868a-b4d6d67dadff admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:40.904162 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:40.904815 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.905101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.905383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] PATH_INFO: `/v3/projects/b1be81502fbe46d889a10ad90af015dc/users/51e1f587d4984ccc998af1d6208c3b54/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.920236 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1be81502fbe46d889a10ad90af015dc, user_id=51e1f587d4984ccc998af1d6208c3b54, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:40.922959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:40.937567 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1351/2696] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:40 2022] PUT /identity/v3/projects/b1be81502fbe46d889a10ad90af015dc/users/51e1f587d4984ccc998af1d6208c3b54/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:40.942701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:40.943017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:40.943297 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:40.962853 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:40.964096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:41.021613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1346/2697] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:41.031722 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:41.033434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:41.089516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa4852-1bb3-4e23-a624-03aef5eaeef6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:41.093128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0476d-96e2-4522-8496-9fbf2908e521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:41.093771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0476d-96e2-4522-8496-9fbf2908e521 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:41.094056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0476d-96e2-4522-8496-9fbf2908e521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:41.094329 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0476d-96e2-4522-8496-9fbf2908e521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:41.103119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0476d-96e2-4522-8496-9fbf2908e521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:41.104535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0476d-96e2-4522-8496-9fbf2908e521 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:41.113824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1352/2698] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:41.261532 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:41.262989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:41.277253 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a433c-1ebd-4e85-aba8-4559bd8184de None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:41.283177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:41.283831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:41.284115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:41.284401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] PATH_INFO: `/v3/users/168aed3299e64426a4e9ca8b6f89f733` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:41.285655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=168aed3299e64426a4e9ca8b6f89f733)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:41.287643 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:41.318065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:41.342956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168aed3299e64426a4e9ca8b6f89f733'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:41.350295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168aed3299e64426a4e9ca8b6f89f733'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:41.351012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168aed3299e64426a4e9ca8b6f89f733'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:41.351621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168aed3299e64426a4e9ca8b6f89f733'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:41.364391 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168aed3299e64426a4e9ca8b6f89f733'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:41.380653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1347/2699] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:41 2022] DELETE /identity/v3/users/168aed3299e64426a4e9ca8b6f89f733 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:41.385771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:41.386234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:41.386330 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:41.406801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:41.408051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:41.475671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1353/2700] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:41.487611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:41.489038 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:41.555160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11ff4-b58e-41c1-89b1-e9047d5af44b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:41.558831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:41.559446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:41.559731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:41.560005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:41.569093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:41.571113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:41.580761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1348/2701] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:41.992462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:41.993969 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:42.006137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e96a-5c0a-47fe-bb51-157fea548107 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:42.010859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:42.011507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:42.011789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:42.012065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] PATH_INFO: `/v3/projects/ae53a0ef1ed14a34bc6e66536d09d9f6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:42.013232 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae53a0ef1ed14a34bc6e66536d09d9f6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:42.015182 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:42.059572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:42.073121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae53a0ef1ed14a34bc6e66536d09d9f6', 'request_id': 'req-04ec3460-2cea-47f3-bdb2-75d6df439154'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.080625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae53a0ef1ed14a34bc6e66536d09d9f6', 'request_id': 'req-04ec3460-2cea-47f3-bdb2-75d6df439154'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.095518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae53a0ef1ed14a34bc6e66536d09d9f6', 'request_id': 'req-04ec3460-2cea-47f3-bdb2-75d6df439154'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.113512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] The token cache is being invalidate because project ae53a0ef1ed14a34bc6e66536d09d9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:42.114609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.114609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.116666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1354/2702] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:41 2022] DELETE /identity/v3/projects/ae53a0ef1ed14a34bc6e66536d09d9f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:42.120354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:42.131632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629546cb-0504-4d81-bbe0-c01f9ceeb3a4 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:42.222298 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:42.223595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:42.223723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:42.224079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] PATH_INFO: `/v3/users/8e70009480964e958b528f3a723d7419` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:42.226632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e70009480964e958b528f3a723d7419)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:42.229588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:42.290775 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e70009480964e958b528f3a723d7419'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.292042 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:42.301937 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e70009480964e958b528f3a723d7419'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.303170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e70009480964e958b528f3a723d7419'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.304509 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e70009480964e958b528f3a723d7419'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.321666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2e8ce614-6b12-4e4a-8683-d73876ba0933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e70009480964e958b528f3a723d7419'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.340331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1349/2703] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:42 2022] DELETE /identity/v3/users/8e70009480964e958b528f3a723d7419 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:42.714896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:42.716512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:42.733740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec3460-2cea-47f3-bdb2-75d6df439154 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:42.827570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:42.828220 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:42.828504 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:42.828784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] PATH_INFO: `/v3/projects/3aa252f921e249738c2b2b03442c821f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:42.829983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa252f921e249738c2b2b03442c821f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:42.831890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:42.881219 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa252f921e249738c2b2b03442c821f', 'request_id': 'req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.887623 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa252f921e249738c2b2b03442c821f', 'request_id': 'req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.893761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa252f921e249738c2b2b03442c821f', 'request_id': 'req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.907606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] The token cache is being invalidate because project 3aa252f921e249738c2b2b03442c821f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:42.907899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.908529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8ebdd3a-45f7-4146-92c2-6f388d0b6521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:42.910156 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1355/2704] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:42 2022] DELETE /identity/v3/projects/3aa252f921e249738c2b2b03442c821f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:42.915533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:42.915826 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:42.916108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:42.938008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:42.939625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:43.017128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1350/2705] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:43.025434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.025764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.026047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.048053 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:43.049278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:43.058175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1356/2706] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:43.062410 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.072200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79341d38-24b0-4198-a025-876cc69c5e0b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.076827 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.077437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.078175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.078458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.079161 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:43.079462 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.081057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.093354 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1351/2707] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:53:43.098117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.108675 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36034feb-4f2b-4d29-b275-13fcde91cc3f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.113622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.114362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.114746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.115077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.115826 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.117913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.147684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1357/2708] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:43 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:43.152510 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.165326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca543ea-03bd-46e7-95e7-2d8068b57b23 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.231127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.231127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.231429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.231595 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.232415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.234366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.264751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1352/2709] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:43 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:53:43.269269 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.281817 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18dd7-17eb-4cda-8cdf-badbca583a99 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.287263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.287893 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.288183 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.288494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.289197 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.290911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.305651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1358/2710] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:43.307117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.317196 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fe96e-f3d4-4c21-9bc1-c3d8d1e7197b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.322696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1071-2b9b-451a-ab0d-a10e99c88b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.323325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1071-2b9b-451a-ab0d-a10e99c88b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.323603 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1071-2b9b-451a-ab0d-a10e99c88b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.323876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1071-2b9b-451a-ab0d-a10e99c88b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.324571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1071-2b9b-451a-ab0d-a10e99c88b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.326214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1071-2b9b-451a-ab0d-a10e99c88b58 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.340413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1353/2711] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:53:43.344460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.355549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb14643-8c4d-4d31-829b-fa8623e89ba9 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.360471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.361149 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.361428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.361755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] PATH_INFO: `/v3/projects/eb5124a05c0b49e1aab883902b25d7f6/users/65a469b067ac48eda4d7769df0429269/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.376390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:43.382975 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5124a05c0b49e1aab883902b25d7f6, user_id=65a469b067ac48eda4d7769df0429269, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.390420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.406412 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1359/2712] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:43 2022] PUT /identity/v3/projects/eb5124a05c0b49e1aab883902b25d7f6/users/65a469b067ac48eda4d7769df0429269/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:43.417954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea29c-6757-40b8-bc1a-aeb618575518 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.418320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea29c-6757-40b8-bc1a-aeb618575518 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.418531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea29c-6757-40b8-bc1a-aeb618575518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.448128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-657ea29c-6757-40b8-bc1a-aeb618575518 None None] MFA Rules not processed for user `65a469b067ac48eda4d7769df0429269`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:43.449355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-657ea29c-6757-40b8-bc1a-aeb618575518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:43.472264 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:43.532396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1354/2713] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:43.544178 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:43.546146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:43.620394 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef57a7e-bd95-4dbb-8e5d-4d131b093e7f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:43.625916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:43.627015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:43.627310 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:43.627587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:43.637630 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:43.639125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:43.650026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1360/2714] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:45.362634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:45.363226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:45.363772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:45.404702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] MFA Rules not processed for user `51e1f587d4984ccc998af1d6208c3b54`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:45.405953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:45.497667 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1355/2715] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:45.510087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:45.511460 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:45.603840 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b500-18e5-4019-85c5-a3cadaf788f2 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:45.610830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bc4a-0660-4b49-9bd5-5e87f34965ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:45.611994 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bc4a-0660-4b49-9bd5-5e87f34965ea service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:45.612360 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bc4a-0660-4b49-9bd5-5e87f34965ea service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:45.612711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bc4a-0660-4b49-9bd5-5e87f34965ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:45.624794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8bc4a-0660-4b49-9bd5-5e87f34965ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:45.626533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8bc4a-0660-4b49-9bd5-5e87f34965ea service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:45.638038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1361/2716] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:46.999420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:47.081106 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7563e2-bc33-471e-a89c-d6289759e99c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:47.088773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:47.089584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:47.090001 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:47.090384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] PATH_INFO: `/v3/users/65a469b067ac48eda4d7769df0429269` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:47.092025 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a469b067ac48eda4d7769df0429269)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:47.094054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:47.151101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a469b067ac48eda4d7769df0429269'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.155507 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:47.158285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a469b067ac48eda4d7769df0429269'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.159187 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a469b067ac48eda4d7769df0429269'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.160054 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a469b067ac48eda4d7769df0429269'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.173906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a469b067ac48eda4d7769df0429269'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.189313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1356/2717] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:53:46 2022] DELETE /identity/v3/users/65a469b067ac48eda4d7769df0429269 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:47.193523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:47.194037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:47.194366 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:47.215196 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:47.216425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:47.288144 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1362/2718] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:47.301073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:47.303234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:47.365313 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6baf90-fc22-4705-b1f5-3722f0233811 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:47.369527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9928cd-f5a4-4cf2-9ab6-6e317e0f2152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:47.370179 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9928cd-f5a4-4cf2-9ab6-6e317e0f2152 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:47.370464 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9928cd-f5a4-4cf2-9ab6-6e317e0f2152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:47.370744 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9928cd-f5a4-4cf2-9ab6-6e317e0f2152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:47.381664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9928cd-f5a4-4cf2-9ab6-6e317e0f2152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:47.383904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9928cd-f5a4-4cf2-9ab6-6e317e0f2152 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:47.394597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1357/2719] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:47.773260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:47.774741 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:47.793568 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385c04-2492-4a34-937f-1777d9feb42f None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:47.801091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:47.802203 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:47.805634 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:47.805960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] PATH_INFO: `/v3/projects/eb5124a05c0b49e1aab883902b25d7f6` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:47.807365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5124a05c0b49e1aab883902b25d7f6)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:47.809320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:47.830702 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:47.878474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5124a05c0b49e1aab883902b25d7f6', 'request_id': 'req-019d7505-4e36-4d2b-9f96-ebdd539fe41b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.885305 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5124a05c0b49e1aab883902b25d7f6', 'request_id': 'req-019d7505-4e36-4d2b-9f96-ebdd539fe41b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.893318 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5124a05c0b49e1aab883902b25d7f6', 'request_id': 'req-019d7505-4e36-4d2b-9f96-ebdd539fe41b'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.914284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] The token cache is being invalidate because project eb5124a05c0b49e1aab883902b25d7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:53:47.914585 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.915595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-019d7505-4e36-4d2b-9f96-ebdd539fe41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:53:47.917384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1363/2720] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:53:47 2022] DELETE /identity/v3/projects/eb5124a05c0b49e1aab883902b25d7f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 04:53:47.923339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ec59-5f6a-4871-aad4-7d731a784c4e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:47.923631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ec59-5f6a-4871-aad4-7d731a784c4e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:47.923904 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ec59-5f6a-4871-aad4-7d731a784c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:47.977378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b220ec59-5f6a-4871-aad4-7d731a784c4e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:47.979043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b220ec59-5f6a-4871-aad4-7d731a784c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.064164 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1358/2721] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:48.089696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.090063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.090266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.120092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] MFA Rules not processed for user `51e1f587d4984ccc998af1d6208c3b54`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:48.121653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.140975 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.141256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.141539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.162482 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:48.163768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.172888 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1359/2722] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:48.177407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.188124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d0c32-654a-4297-857a-8cb2cd1ed473 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.188765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1364/2723] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:48.192963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.193675 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.193962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.194276 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.195552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:53:48.196552 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.197621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.210506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1360/2724] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 04:53:48.214761 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.226086 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8ecd2-61e5-428b-814d-56348bbd9e76 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.231600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.232570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.233028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.233517 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.234578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.236676 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.280422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1365/2725] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:53:48 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:53:48.284319 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.297501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d1266-3c7f-404d-8b00-138134542c25 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.370653 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:48.389863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.390545 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.390829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.391100 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.392487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.394644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.427447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1361/2726] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:53:48 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 04:53:48.428694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.441805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546eb9a-f002-474a-a51f-72c46756e96a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.451014 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.451658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.451940 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.452215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.452926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.454603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.469011 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1366/2727] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:48.472887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.485188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2b48-703b-421e-9382-ee537df802ff admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.491324 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22f39-4df5-463e-b46e-bcf0c50ea9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.492244 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22f39-4df5-463e-b46e-bcf0c50ea9af admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.492598 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22f39-4df5-463e-b46e-bcf0c50ea9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.492972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22f39-4df5-463e-b46e-bcf0c50ea9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.493802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22f39-4df5-463e-b46e-bcf0c50ea9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.495514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22f39-4df5-463e-b46e-bcf0c50ea9af admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.510053 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1362/2728] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 04:53:48.514440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.526051 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55fc3c-d7f3-4ef0-b502-ff2620b35fdf admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.531392 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.532002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.532284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.532558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] PATH_INFO: `/v3/projects/052dc3d58c4d48509fa23979c379d787/users/f47c332b15fe404ea1b77375239473ef/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.550572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] RBAC: Authorizing `identity:create_grant(project_id=052dc3d58c4d48509fa23979c379d787, user_id=f47c332b15fe404ea1b77375239473ef, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.553521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.586764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1367/2729] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:53:48 2022] PUT /identity/v3/projects/052dc3d58c4d48509fa23979c379d787/users/f47c332b15fe404ea1b77375239473ef/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:53:48.589071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.589702 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.590160 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.636398 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:48.637712 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.782498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1363/2730] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:48.795651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.798573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.864072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:48.868933 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d2ed9-3cf1-47c0-bea6-e3a974a3265b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.875878 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.877031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.877629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.878343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.891389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.892922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.906430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:48.907878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.909775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1368/2731] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:53:48.927293 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d24da-65f5-4cff-b604-8345cb9185af None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:48.934321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:48.935476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:48.935962 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:48.936758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:48.939663 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:48.954217 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:48.956131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6868a94-1185-4bd2-b8a3-c7fda955d3ec service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:48.967043 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1364/2732] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:53:49.351698 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:49.353133 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:49.443851 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb94df-ae8e-4bed-9f2c-6efcbe619582 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:49.453617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:49.454303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:49.454584 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:49.454857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:49.456718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:49.469935 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:49.471600 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:49.483999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1369/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:49.667839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176aeff-8bb5-48fc-a09e-2cab6b11bbaf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:49.668486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176aeff-8bb5-48fc-a09e-2cab6b11bbaf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:49.668486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176aeff-8bb5-48fc-a09e-2cab6b11bbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:49.713127 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1176aeff-8bb5-48fc-a09e-2cab6b11bbaf None None] MFA Rules not processed for user `f47c332b15fe404ea1b77375239473ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:49.714763 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1176aeff-8bb5-48fc-a09e-2cab6b11bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:49.818051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1365/2734] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:53:49.833462 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:49.835512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:49.940333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c514f-f537-4cba-aab1-0e77006376c2 service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:49.947415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:49.948060 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:49.948346 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:49.948624 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:49.959934 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:49.961876 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:49.974506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1370/2735] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:53:51.380199 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:51.380732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:51.380830 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:51.400537 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] MFA Rules not processed for user `f47c332b15fe404ea1b77375239473ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:53:51.401792 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:51.409407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1366/2736] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:53:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 04:53:51.594074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:53:51.605981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6516-ac4c-4ffb-bcf0-75c362f2e593 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:53:51.609899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:53:51.610549 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:53:51.610795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:53:51.611069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:53:51.613430 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:53:51.629982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:53:51.631856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:53:51.644298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1371/2737] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:53:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:54:01.394604 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:01.640484 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=68 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:03.452404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:03.453930 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:03.535549 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039ab9-b8a2-4f07-9c1e-5f8899cdc98d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:03.543691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:03.544348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:03.544632 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:03.544906 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:03.546697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:03.560933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:03.562563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa404fa-6569-4fd6-9b95-19ebb9c7e739 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:03.574131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1367/2738] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:54:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 29 04:54:09.031949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:09.033708 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:09.050246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82921d-5618-4352-a222-4a53437ed720 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:09.056079 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:09.056729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:09.057036 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:09.057397 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:09.059482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:09.072962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:09.074596 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:09.085331 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1372/2739] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:54:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:54:10.340899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:10.341367 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:10.341460 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:10.359818 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] MFA Rules not processed for user `f47c332b15fe404ea1b77375239473ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:54:10.361028 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:10.367829 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1368/2740] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:54:10.601333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:10.610793 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b6cb7-f6cd-4652-851a-fd328d15b568 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:10.614404 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:10.615008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:10.615291 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:10.615570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:10.617877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:10.627411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:10.628827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395d12-9c0f-455f-a37c-e706708b9124 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:10.637569 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1373/2741] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:54:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:54:19.372008 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:19.386007 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967665b0-3dde-43d4-bfd6-8da9183a627c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:19.391452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:19.392065 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:19.392347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:19.392623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:19.394409 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:19.407189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:19.408773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:19.420448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1369/2742] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:54:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:54:20.634001 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=12 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:27.221899 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6a00-33b1-4ddc-abf1-545bcf0cef40 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:27.222474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6a00-33b1-4ddc-abf1-545bcf0cef40 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:27.222474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf6a00-33b1-4ddc-abf1-545bcf0cef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:27.272363 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-28bf6a00-33b1-4ddc-abf1-545bcf0cef40 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:54:27.273617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-28bf6a00-33b1-4ddc-abf1-545bcf0cef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:27.337839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1374/2743] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 29 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:54:27.384816 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:27.386258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:27.480322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458be3e-58a0-4f94-b76f-0ca4e8a00798 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:27.485422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:27.486134 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:27.486421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:27.486697 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:27.494687 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:27.496269 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:27.504754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1370/2744] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:54:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:54:37.334434 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=40 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:37.501517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:41.793964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:41.794409 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:41.794503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:41.813990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] MFA Rules not processed for user `a8075821457e4e8b8a50815e70f1d759`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:54:41.815277 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:41.823453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1375/2745] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 29 04:54:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:54:41.835629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:41.847046 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc01c-e8ce-4212-8542-c5e75c1c87cc service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:41.852128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb7a5feda014624a86d87043526023d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:41.852734 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:41.853012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:41.853284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:41.861323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:41.862919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:41.873265 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1371/2746] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 29 04:54:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 29 04:54:43.769472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:43.782442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66169-f87c-4bfe-a9d8-fb8205ad8820 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:43.787160 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:43.787802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:43.788081 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:43.788353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] PATH_INFO: `/v3/users/f47c332b15fe404ea1b77375239473ef` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:43.789498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47c332b15fe404ea1b77375239473ef)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:43.792126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:43.839593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47c332b15fe404ea1b77375239473ef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:43.846174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47c332b15fe404ea1b77375239473ef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:43.846828 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47c332b15fe404ea1b77375239473ef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:43.847425 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47c332b15fe404ea1b77375239473ef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:43.863696 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7904e3f-25bf-4e30-8248-e54c6b594c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47c332b15fe404ea1b77375239473ef'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:43.880061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1376/2747] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:54:43 2022] DELETE /identity/v3/users/f47c332b15fe404ea1b77375239473ef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:54:44.058308 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.069151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf7089-04bb-4337-961b-dffe5653566c service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.129467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.130056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.130339 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.130614 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] PATH_INFO: `/v3/projects/052dc3d58c4d48509fa23979c379d787` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.131843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=052dc3d58c4d48509fa23979c379d787)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.134291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.190720 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052dc3d58c4d48509fa23979c379d787', 'request_id': 'req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:44.197181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052dc3d58c4d48509fa23979c379d787', 'request_id': 'req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:44.202528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052dc3d58c4d48509fa23979c379d787', 'request_id': 'req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:44.215059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] The token cache is being invalidate because project 052dc3d58c4d48509fa23979c379d787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:54:44.215349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:44.215971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc0151f0-b1d3-42ee-b4f2-d8f4836bb7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:54:44.217488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1372/2748] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:54:44 2022] DELETE /identity/v3/projects/052dc3d58c4d48509fa23979c379d787 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:54:44.223348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.223644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.223925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.243311 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:54:44.244518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:44.301415 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1377/2749] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:54:44.309819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.310103 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.310404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.329955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:54:44.331137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:44.339411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1373/2750] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:54:44.343551 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.353222 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ff43-5183-49b1-aa4d-e3acfdc6b810 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.357800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.358402 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.358685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.358959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.359649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 04:54:44.359955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.361535 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.373322 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1378/2751] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 04:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 04:54:44.377427 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.387214 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61142bd-6631-4757-a899-280ec56d5f8e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.391670 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.392256 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.392533 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.392800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.393451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.395350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.421290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1374/2752] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 04:54:44 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:54:44.425472 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.436245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176006-a4f1-4ffd-b2a2-c031b55685bb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.483304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:44.494621 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.495240 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.495527 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.495805 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.496487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.498453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.531142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1379/2753] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 04:54:44 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 04:54:44.532476 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.543230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a23b11-2bd1-475e-b504-eb22251cbe37 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.547900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.548508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.548791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.549064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.549779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.551370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.561863 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1375/2754] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:54:44.566124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.576774 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d71f-8776-475a-be78-c36dfc211e70 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.581427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28e08c-b463-468a-b1c2-292d6f531219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.582064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28e08c-b463-468a-b1c2-292d6f531219 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.582348 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28e08c-b463-468a-b1c2-292d6f531219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.582622 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28e08c-b463-468a-b1c2-292d6f531219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.583307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28e08c-b463-468a-b1c2-292d6f531219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.584883 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28e08c-b463-468a-b1c2-292d6f531219 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.595239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1380/2755] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 04:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 04:54:44.599137 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.609086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612070aa-57af-4158-9bca-1b3b118171b0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.613768 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.614413 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.614694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.614970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] PATH_INFO: `/v3/projects/d46c8e4996444c38b6d00958e28bf3f3/users/88c9dee1aee04603aed366b92ab3be7e/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.629688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46c8e4996444c38b6d00958e28bf3f3, user_id=88c9dee1aee04603aed366b92ab3be7e, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.632321 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.645631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1376/2756] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 04:54:44 2022] PUT /identity/v3/projects/d46c8e4996444c38b6d00958e28bf3f3/users/88c9dee1aee04603aed366b92ab3be7e/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:54:44.656303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.656593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.656874 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.686065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] MFA Rules not processed for user `88c9dee1aee04603aed366b92ab3be7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:54:44.687263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:44.750662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1381/2757] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:54:44.762189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:54:44.763874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:54:44.777938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:44.824621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ef97c-ab1c-482d-889d-dc092e0b2e6e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:54:44.828206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f8bd-ec07-427e-ba05-72f771a2684b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dddbf2245fc4a71b91102e821f177ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:54:44.828821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f8bd-ec07-427e-ba05-72f771a2684b service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:54:44.829104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f8bd-ec07-427e-ba05-72f771a2684b service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:54:44.829376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f8bd-ec07-427e-ba05-72f771a2684b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:54:44.837682 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2f8bd-ec07-427e-ba05-72f771a2684b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:54:44.839117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2f8bd-ec07-427e-ba05-72f771a2684b service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:54:44.847866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1377/2758] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:54:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:54:54.747745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:54.843777 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=20 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:12.874839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:55:12.937210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f07c4d-e388-47d4-b615-fc463c265cde None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:55:12.941721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:55:12.942368 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:55:12.942645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:55:12.942918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] PATH_INFO: `/v3/users/88c9dee1aee04603aed366b92ab3be7e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:55:12.944110 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c9dee1aee04603aed366b92ab3be7e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:55:12.946067 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:55:12.991755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c9dee1aee04603aed366b92ab3be7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:12.998646 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c9dee1aee04603aed366b92ab3be7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:12.999303 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c9dee1aee04603aed366b92ab3be7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:12.999923 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c9dee1aee04603aed366b92ab3be7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.011443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c9dee1aee04603aed366b92ab3be7e'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.023740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1382/2759] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 04:55:12 2022] DELETE /identity/v3/users/88c9dee1aee04603aed366b92ab3be7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:55:13.028840 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:55:13.029341 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:55:13.029455 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:55:13.048463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:55:13.049698 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:55:13.106672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1378/2760] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:55:13.116292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:55:13.117732 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:55:13.173422 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e41a-454c-4c0d-9261-e9fade0b0037 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:55:13.177003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:55:13.177620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:55:13.177912 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:55:13.178451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:55:13.187477 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:55:13.188988 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:55:13.198561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1383/2761] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:55:13.472350 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:55:13.473861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:55:13.487691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a541d5-4d73-46ca-8844-0599fe6d146f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:55:13.492428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:55:13.493704 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:55:13.493998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:55:13.494453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] PATH_INFO: `/v3/projects/d46c8e4996444c38b6d00958e28bf3f3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:55:13.495696 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46c8e4996444c38b6d00958e28bf3f3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:55:13.498085 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:55:13.544669 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46c8e4996444c38b6d00958e28bf3f3', 'request_id': 'req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.551250 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46c8e4996444c38b6d00958e28bf3f3', 'request_id': 'req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.557182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46c8e4996444c38b6d00958e28bf3f3', 'request_id': 'req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.569967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] The token cache is being invalidate because project d46c8e4996444c38b6d00958e28bf3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 04:55:13.570251 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.570857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3c3442a-f9cf-4045-8961-b5dd9dfa1611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 04:55:13.572331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1379/2762] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 04:55:13 2022] DELETE /identity/v3/projects/d46c8e4996444c38b6d00958e28bf3f3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 04:55:23.194386 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:23.566932 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:18.788981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:57:18.790465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:57:18.859083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93498-53aa-4772-ba8c-dbecf327b07e service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:57:18.916714 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:57:18.917324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:57:18.917617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:57:18.917910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:57:18.919625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:57:18.931979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:57:18.933577 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:57:18.944248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1384/2763] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:57:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:57:28.939395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=58 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:19.955300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:58:19.955850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:58:19.955850 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:58:19.976536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] MFA Rules not processed for user `51e1f587d4984ccc998af1d6208c3b54`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 04:58:19.977815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:58:20.034230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1380/2764] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 04:58:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 04:58:29.851794 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:58:29.853206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:58:29.909326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6c96e-4543-43da-9bef-39cab723d5ab service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:58:29.912938 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:58:29.913544 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:58:29.913864 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:58:29.914140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:58:29.915877 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:58:29.986581 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:58:29.988015 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:58:29.999647 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1385/2765] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:58:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:58:30.027224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:32.350528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:58:32.352063 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:58:32.364205 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b4ca-c84b-4b5e-88db-5293c03c2449 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:58:32.367837 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:58:32.368443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:58:32.368725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:58:32.369002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:58:32.370743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:58:32.383880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:58:32.385299 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:58:32.396453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1381/2766] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:58:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:58:39.994795 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=54 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:42.391437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:59:24.426285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:59:24.435771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946d383-595e-4997-abdb-c10d0cb05cb0 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:59:24.439349 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:59:24.439951 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:59:24.440228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:59:24.440499 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:59:24.442226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:59:24.451961 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:59:24.453369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:59:24.461857 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1386/2767] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:59:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 04:59:34.457660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=6 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:59:49.992342 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 04:59:49.994404 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:59:50.009588 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42186-ade7-4627-a8ca-1be94f27bda6 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 04:59:50.014985 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 04:59:50.015579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 04:59:50.015859 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 04:59:50.016133 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 04:59:50.017934 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 04:59:50.028478 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 04:59:50.030069 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 04:59:50.038715 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1382/2768] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 04:59:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:00.034822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:05.272217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:05.286586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b96ddc-72a8-4ae5-a15a-d18a6cc946a5 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:05.292888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2919227b992743178d0128981ad54c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:05.293521 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:05.293866 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:05.294146 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:05.296127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:05.311327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:05.313089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:05.353307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1387/2769] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:10.250794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:10.260751 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484e44a-1511-4ad6-856b-aab9e8669f33 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:10.264558 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:10.265177 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:10.265463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:10.265779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:10.267563 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:10.329189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:10.330655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:10.340117 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1383/2770] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:13.152324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.153968 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:13.173819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af94c-53d8-4ed6-8bd6-b1a33eadcd88 service nova] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.179195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.179922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.180267 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.180638 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.188264 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:13.203492 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.205108 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.208956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.210572 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:13.220533 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1388/2771] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:13.223629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5bbed-b27a-4148-b8a9-c384e0342ff2 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.228943 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.229688 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.230174 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.230584 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] PATH_INFO: `/v3/users/51e1f587d4984ccc998af1d6208c3b54` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.231877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e1f587d4984ccc998af1d6208c3b54)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.233901 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.281385 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e1f587d4984ccc998af1d6208c3b54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.288193 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e1f587d4984ccc998af1d6208c3b54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.288855 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e1f587d4984ccc998af1d6208c3b54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.289463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e1f587d4984ccc998af1d6208c3b54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.301648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b0e2037c-6679-4e62-866e-d68456f20cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e1f587d4984ccc998af1d6208c3b54'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.314084 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1384/2772] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:00:13 2022] DELETE /identity/v3/users/51e1f587d4984ccc998af1d6208c3b54 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:00:13.487057 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.498187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85e405-44e5-409e-82cd-e18ee5194991 service placement] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.555776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.556398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.556939 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.557211 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] PATH_INFO: `/v3/projects/b1be81502fbe46d889a10ad90af015dc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.558395 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1be81502fbe46d889a10ad90af015dc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.560276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.605257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1be81502fbe46d889a10ad90af015dc', 'request_id': 'req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.611125 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1be81502fbe46d889a10ad90af015dc', 'request_id': 'req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.616489 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1be81502fbe46d889a10ad90af015dc', 'request_id': 'req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.628376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] The token cache is being invalidate because project b1be81502fbe46d889a10ad90af015dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:00:13.628665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.629292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-a7ac71ad-e23e-43bc-b8d5-184a55dde89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:13.630797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1389/2773] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:00:13 2022] DELETE /identity/v3/projects/b1be81502fbe46d889a10ad90af015dc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:00:13.636241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.636527 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.636801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.657088 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:13.658362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:13.715758 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1385/2774] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:13.723783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.724077 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.724369 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.743688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:13.744891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:13.752659 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1390/2775] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:13.756762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.767357 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ed29f-add4-4688-b9fa-5c28ccb19984 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.771894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.772493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.772772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.773045 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.773794 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:00:13.774101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.776302 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.777813 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:13.790854 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1386/2776] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:00:13.795072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.804272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179c5ab-2004-4d9a-beab-ece3f9e02853 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.809237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.809880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.810164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.810438 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.811104 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.813017 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.841429 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1391/2777] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:00:13 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 05:00:13.845517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.855528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173aabf-ccd9-4ef6-a42c-7d3ecd753506 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.910799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.911322 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.911621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.911890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.912553 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.914501 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.938143 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1387/2778] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:00:13 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 05:00:13.943257 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.955119 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b474c89-f58f-43e9-b84f-0d20aa019276 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.960728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.961350 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.961684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.961958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.962684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.964274 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:13.974514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1392/2779] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:13.978485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:13.988638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657c6e1-7a06-49f1-b2b4-12c62cd6b6a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:13.993824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459f8a4-7d4d-4636-8536-5bd62f5a1c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:13.994452 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459f8a4-7d4d-4636-8536-5bd62f5a1c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:13.994737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459f8a4-7d4d-4636-8536-5bd62f5a1c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:13.995013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459f8a4-7d4d-4636-8536-5bd62f5a1c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:13.995706 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459f8a4-7d4d-4636-8536-5bd62f5a1c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:13.997305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459f8a4-7d4d-4636-8536-5bd62f5a1c4e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.008234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1388/2780] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:14.013009 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.023418 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c1637-9496-4587-9642-8a617def3deb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.028538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.029247 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.029528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.029839 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] PATH_INFO: `/v3/projects/127762a779af49dbbd566530463404a2/users/51ad57d8510a4916b557907ce78a6d96/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.044835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=127762a779af49dbbd566530463404a2, user_id=51ad57d8510a4916b557907ce78a6d96, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.047515 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.057959 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:14.064006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1393/2781] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:14 2022] PUT /identity/v3/projects/127762a779af49dbbd566530463404a2/users/51ad57d8510a4916b557907ce78a6d96/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:14.075428 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.075724 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.076005 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.104441 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] MFA Rules not processed for user `51ad57d8510a4916b557907ce78a6d96`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:14.105725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:14.168239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1389/2782] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:14.172654 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.231992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6a76-0d00-4fec-b0de-146fba13ae1d admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.236512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.237109 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.237388 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.237692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.238431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.240325 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.266179 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1394/2783] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:00:14 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:14.270284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.281467 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa8829-5520-4c62-a6aa-579d0cd9aa3e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.335070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.335691 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.335956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.336230 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.336889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.339470 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.348062 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:14.360314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1390/2784] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:00:14 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:14.364239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.374724 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e282-623b-4164-a64d-249ad9c1fc0f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.380781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.381416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.381743 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.382028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.382764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.386374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.409911 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1395/2785] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:14.414918 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.425192 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b456a-a285-464d-aaf3-84ea3483a164 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.429836 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.430499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.430785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.431066 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] PATH_INFO: `/v3/projects/7bb1b6ef9d424f4abf74ec75f87deb2e/users/ea86ca6a753a45d7a66ef934acd38b05/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.445928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb1b6ef9d424f4abf74ec75f87deb2e, user_id=ea86ca6a753a45d7a66ef934acd38b05, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.449363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.462815 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1391/2786] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:14 2022] PUT /identity/v3/projects/7bb1b6ef9d424f4abf74ec75f87deb2e/users/ea86ca6a753a45d7a66ef934acd38b05/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:14.466855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.476782 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219fde8-f51f-464d-bebb-ab24b287b3ef admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.531561 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0763d0-75bb-40d5-9e3d-8f4123bb5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.532173 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0763d0-75bb-40d5-9e3d-8f4123bb5d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.532474 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0763d0-75bb-40d5-9e3d-8f4123bb5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.532750 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0763d0-75bb-40d5-9e3d-8f4123bb5d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.533431 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0763d0-75bb-40d5-9e3d-8f4123bb5d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.535069 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0763d0-75bb-40d5-9e3d-8f4123bb5d5a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.544529 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1396/2787] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:14.548900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.564280 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c4de-d251-41e8-b839-0669484bd56f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.568839 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.569520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.569835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.570115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] PATH_INFO: `/v3/projects/7bb1b6ef9d424f4abf74ec75f87deb2e/users/ea86ca6a753a45d7a66ef934acd38b05/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.572580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb1b6ef9d424f4abf74ec75f87deb2e, user_id=ea86ca6a753a45d7a66ef934acd38b05, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.575270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.585287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1392/2788] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:14 2022] PUT /identity/v3/projects/7bb1b6ef9d424f4abf74ec75f87deb2e/users/ea86ca6a753a45d7a66ef934acd38b05/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:14.596018 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.596314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.596593 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.625165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] MFA Rules not processed for user `ea86ca6a753a45d7a66ef934acd38b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:14.626441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:14.685541 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:14.695159 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1397/2789] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:14.706912 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.708589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:14.772899 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711144a5-b414-42d5-afa0-399274afc2fd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.776536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.777146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.777424 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.777729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.786659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.788071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.797314 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1393/2790] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:14.873687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:14.883509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ba1bc-028b-465f-9bb8-af4cd4384684 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:14.887833 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c4ad-ba3c-4870-916a-8338cc0fcc21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:14.888473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c4ad-ba3c-4870-916a-8338cc0fcc21 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:14.888758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c4ad-ba3c-4870-916a-8338cc0fcc21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:14.889038 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c4ad-ba3c-4870-916a-8338cc0fcc21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:14.944479 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9c4ad-ba3c-4870-916a-8338cc0fcc21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:14.945891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9c4ad-ba3c-4870-916a-8338cc0fcc21 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:14.955875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1398/2791] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:24.793181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:24.951796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=30 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:43.868732 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:43.930112 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c1cfa-1d3c-49ee-b12a-8dd8805f583b service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:43.935466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:43.936116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:43.936401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:43.936678 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] PATH_INFO: `/v3/users/51ad57d8510a4916b557907ce78a6d96` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:43.937858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ad57d8510a4916b557907ce78a6d96)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:43.939791 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:43.989605 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ad57d8510a4916b557907ce78a6d96'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:43.996862 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ad57d8510a4916b557907ce78a6d96'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:43.997516 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ad57d8510a4916b557907ce78a6d96'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:43.998147 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ad57d8510a4916b557907ce78a6d96'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.009797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ad57d8510a4916b557907ce78a6d96'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.022692 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1394/2792] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:00:43 2022] DELETE /identity/v3/users/51ad57d8510a4916b557907ce78a6d96 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:44.027199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:44.027692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:44.027801 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:44.046591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:44.047792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:44.105580 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1399/2793] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:44.115082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:44.116477 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:44.172079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049666-890f-4ded-8ca1-aa9875e2f9b9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:44.175636 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:44.176236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:44.176514 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:44.176788 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:44.186317 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:44.187731 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:44.196933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1395/2794] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:44.460473 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:44.461973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:44.475471 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a43dbe-376c-4687-a3c8-8b82c88f55bb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:44.480926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:44.482401 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:44.482685 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:44.482964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] PATH_INFO: `/v3/projects/127762a779af49dbbd566530463404a2` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:44.484234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=127762a779af49dbbd566530463404a2)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:44.486204 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:44.532573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127762a779af49dbbd566530463404a2', 'request_id': 'req-e82c085b-4d54-42ec-9474-2ede16e9c4ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.538610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127762a779af49dbbd566530463404a2', 'request_id': 'req-e82c085b-4d54-42ec-9474-2ede16e9c4ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.544960 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127762a779af49dbbd566530463404a2', 'request_id': 'req-e82c085b-4d54-42ec-9474-2ede16e9c4ed'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.557362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] The token cache is being invalidate because project 127762a779af49dbbd566530463404a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:00:44.557679 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.558916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.560405 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1400/2795] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:00:44 2022] DELETE /identity/v3/projects/127762a779af49dbbd566530463404a2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:44.564369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:44.574437 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3e06a-f4d4-4176-98ee-c5b018008786 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:44.592597 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:44.630726 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:44.631355 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:44.631638 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:44.631917 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] PATH_INFO: `/v3/users/ea86ca6a753a45d7a66ef934acd38b05` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:44.633064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea86ca6a753a45d7a66ef934acd38b05)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:44.635009 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:44.679422 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea86ca6a753a45d7a66ef934acd38b05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.686629 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea86ca6a753a45d7a66ef934acd38b05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.687284 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea86ca6a753a45d7a66ef934acd38b05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.687893 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea86ca6a753a45d7a66ef934acd38b05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.699401 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2245cbb1-b846-4818-8593-4bed43402e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea86ca6a753a45d7a66ef934acd38b05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:44.711612 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1396/2796] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:00:44 2022] DELETE /identity/v3/users/ea86ca6a753a45d7a66ef934acd38b05 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:44.990292 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:44.997511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:45.012045 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c085b-4d54-42ec-9474-2ede16e9c4ed admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.072513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.073174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.073342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.073648 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] PATH_INFO: `/v3/projects/7bb1b6ef9d424f4abf74ec75f87deb2e` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.074855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb1b6ef9d424f4abf74ec75f87deb2e)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.076799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.107253 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:45.125235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb1b6ef9d424f4abf74ec75f87deb2e', 'request_id': 'req-081b5a77-be7d-4785-afe0-67c5ceb50c69'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:45.131261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb1b6ef9d424f4abf74ec75f87deb2e', 'request_id': 'req-081b5a77-be7d-4785-afe0-67c5ceb50c69'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:45.136819 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb1b6ef9d424f4abf74ec75f87deb2e', 'request_id': 'req-081b5a77-be7d-4785-afe0-67c5ceb50c69'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:45.149536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] The token cache is being invalidate because project 7bb1b6ef9d424f4abf74ec75f87deb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:00:45.149867 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:45.150488 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-081b5a77-be7d-4785-afe0-67c5ceb50c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:45.152012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1401/2797] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:00:44 2022] DELETE /identity/v3/projects/7bb1b6ef9d424f4abf74ec75f87deb2e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:45.156889 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.157375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.157498 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.177030 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:45.178270 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:45.235890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1397/2798] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:45.243890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.244070 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.244347 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.274383 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:45.276164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:45.286298 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1402/2799] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:45.290651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.300856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c5351-1735-4e3a-b1b3-7bc305a6a051 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.305399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.306044 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.306326 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.306601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.307550 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:00:45.307857 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.310113 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.321380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1398/2800] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:00:45.325643 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.334803 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8ec64-56a0-4f72-aa0d-1867f8faa149 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.339967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.340570 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.340853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.341129 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.341835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.343719 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.370193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1403/2801] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:45.374737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.384631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621128c-b8b9-49d6-b22c-52e9053d1c91 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.409878 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:45.441877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.442488 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.442772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.443048 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.443713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.445647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.466051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1399/2802] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 29 05:00:45.470448 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.481983 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96355f43-3232-4133-85e2-13240f3acfc2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.488090 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.488752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.489032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.489326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.490056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.491645 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.501846 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1404/2803] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:45.505890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.515909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbcf34-6d2e-4684-b17a-d35e70c5bf5d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.520518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043f84-70eb-48ae-8000-24a1f46554bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.521115 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043f84-70eb-48ae-8000-24a1f46554bd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.521399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043f84-70eb-48ae-8000-24a1f46554bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.521695 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043f84-70eb-48ae-8000-24a1f46554bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.522382 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043f84-70eb-48ae-8000-24a1f46554bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.523972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043f84-70eb-48ae-8000-24a1f46554bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.534858 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1400/2804] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 05:00:45.538956 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.548987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81a95-387d-4b4c-bee7-275f34094948 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.553566 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.554245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.554534 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.554810 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] PATH_INFO: `/v3/projects/65c2ff0e0b1348e1be4aea6716f538a7/users/5e6912ef8451499f9c40f69b1d10805f/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.569818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c2ff0e0b1348e1be4aea6716f538a7, user_id=5e6912ef8451499f9c40f69b1d10805f, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.572658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.585922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1405/2805] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:45 2022] PUT /identity/v3/projects/65c2ff0e0b1348e1be4aea6716f538a7/users/5e6912ef8451499f9c40f69b1d10805f/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:00:45.596182 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.596493 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.596755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.630380 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] MFA Rules not processed for user `5e6912ef8451499f9c40f69b1d10805f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:45.631637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:45.695567 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1401/2806] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:45.700729 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.760587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f9cdb-77f0-40aa-b80b-2a0de157bfa7 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.765169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.765809 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.766092 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.766367 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.767028 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.768906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.795142 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1406/2807] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:45.799178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.810757 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ff2c0-3e7c-41c0-bea0-9deae8c8b20d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.865447 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.866018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.866300 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.866575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.867227 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.869128 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.889363 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1402/2808] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:00:45 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:45.893545 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.904010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda46881-4d92-4bd1-9f64-b4cd18d39cf4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.908590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.909228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.909511 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.909829 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.910513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.912126 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:45.923112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1407/2809] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:45.927162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:45.938814 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1ea8b-1e07-4dff-bb3e-524b85bcede3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:45.947650 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:45.948909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:45.948909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:45.948909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] PATH_INFO: `/v3/projects/e027b533f1214cc799cbfcb717a363a5/users/37dbe6c4035042ec859505301d1f094d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:45.970331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e027b533f1214cc799cbfcb717a363a5, user_id=37dbe6c4035042ec859505301d1f094d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:45.974981 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:46.004892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1403/2810] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:45 2022] PUT /identity/v3/projects/e027b533f1214cc799cbfcb717a363a5/users/37dbe6c4035042ec859505301d1f094d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:46.008947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:46.019131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7817-decd-44bd-ac3e-44bc3fc0a830 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:46.038683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:46.079721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15985d3-ca2c-4540-9ef7-9fccf67290d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:46.080468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15985d3-ca2c-4540-9ef7-9fccf67290d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:46.080771 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15985d3-ca2c-4540-9ef7-9fccf67290d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:46.081056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15985d3-ca2c-4540-9ef7-9fccf67290d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:46.081970 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15985d3-ca2c-4540-9ef7-9fccf67290d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:46.083662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15985d3-ca2c-4540-9ef7-9fccf67290d0 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:46.094164 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1408/2811] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 05:00:46.098290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:46.104000 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:46.111029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34841c7-8cd7-48d0-9868-8d4df386ab10 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:46.116040 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:46.116642 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:46.116928 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:46.117202 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] PATH_INFO: `/v3/projects/e027b533f1214cc799cbfcb717a363a5/users/37dbe6c4035042ec859505301d1f094d/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:46.119301 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e027b533f1214cc799cbfcb717a363a5, user_id=37dbe6c4035042ec859505301d1f094d, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:46.122016 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:46.132096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1404/2812] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:46 2022] PUT /identity/v3/projects/e027b533f1214cc799cbfcb717a363a5/users/37dbe6c4035042ec859505301d1f094d/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:46.197918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:46.198193 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:46.198468 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:46.225783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] MFA Rules not processed for user `37dbe6c4035042ec859505301d1f094d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:46.226992 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:46.308526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1409/2813] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:46.320504 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:46.322343 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:46.380034 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a8d3-cc43-4ac5-9843-8629df686620 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:46.383562 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c093aa2-8038-405d-9168-ec1420497642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:46.384170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093aa2-8038-405d-9168-ec1420497642 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:46.384451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093aa2-8038-405d-9168-ec1420497642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:46.384723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c093aa2-8038-405d-9168-ec1420497642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:46.393538 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093aa2-8038-405d-9168-ec1420497642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:46.394998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c093aa2-8038-405d-9168-ec1420497642 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:46.404845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1405/2814] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:47.907557 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:47.971089 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411b94-7e5c-48db-816f-b3aab90e8f1a None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:47.975625 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:47.976261 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:47.976543 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:47.976830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] PATH_INFO: `/v3/users/5e6912ef8451499f9c40f69b1d10805f` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:47.978112 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6912ef8451499f9c40f69b1d10805f)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:47.980884 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:48.026190 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6912ef8451499f9c40f69b1d10805f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.028046 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:48.034736 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6912ef8451499f9c40f69b1d10805f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.035507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6912ef8451499f9c40f69b1d10805f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.036127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6912ef8451499f9c40f69b1d10805f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.047781 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6912ef8451499f9c40f69b1d10805f'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.060655 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1410/2815] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:00:47 2022] DELETE /identity/v3/users/5e6912ef8451499f9c40f69b1d10805f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:48.065403 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0827-448f-4632-9e47-16be02f62733 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:48.065941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0827-448f-4632-9e47-16be02f62733 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:48.066049 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0827-448f-4632-9e47-16be02f62733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:48.085148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-227b0827-448f-4632-9e47-16be02f62733 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:48.086309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-227b0827-448f-4632-9e47-16be02f62733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:48.145681 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1406/2816] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 29 05:00:48.156512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:48.157955 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:48.218682 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a218a-0b28-45ce-a99a-ee5311e7b243 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:48.222428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:48.223050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:48.223335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:48.223651 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:48.233128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:48.234605 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:48.244010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1411/2817] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:48.517450 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0827-448f-4632-9e47-16be02f62733 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:48.518970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-227b0827-448f-4632-9e47-16be02f62733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:48.532738 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0827-448f-4632-9e47-16be02f62733 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:48.537330 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:48.537998 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:48.538754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:48.539200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] PATH_INFO: `/v3/projects/65c2ff0e0b1348e1be4aea6716f538a7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:48.540594 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c2ff0e0b1348e1be4aea6716f538a7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:48.542995 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:48.590389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c2ff0e0b1348e1be4aea6716f538a7', 'request_id': 'req-80076730-6de7-4e02-a305-6e30b2d0cf46'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.596362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c2ff0e0b1348e1be4aea6716f538a7', 'request_id': 'req-80076730-6de7-4e02-a305-6e30b2d0cf46'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.601915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c2ff0e0b1348e1be4aea6716f538a7', 'request_id': 'req-80076730-6de7-4e02-a305-6e30b2d0cf46'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.614188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] The token cache is being invalidate because project 65c2ff0e0b1348e1be4aea6716f538a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:00:48.614694 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.615592 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.617246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1407/2818] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:00:48 2022] DELETE /identity/v3/projects/65c2ff0e0b1348e1be4aea6716f538a7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:48.622049 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:48.632163 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b3344-6fef-4e46-b266-1f5b7af1f72d service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:48.688538 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:48.689165 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:48.689441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:48.689742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] PATH_INFO: `/v3/users/37dbe6c4035042ec859505301d1f094d` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:48.690889 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37dbe6c4035042ec859505301d1f094d)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:48.692780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:48.737890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37dbe6c4035042ec859505301d1f094d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.744604 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37dbe6c4035042ec859505301d1f094d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.745251 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37dbe6c4035042ec859505301d1f094d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.746437 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37dbe6c4035042ec859505301d1f094d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.756169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:48.758644 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-af02eca5-5698-40c6-9846-7765660c6f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37dbe6c4035042ec859505301d1f094d'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:48.772296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1412/2819] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:00:48 2022] DELETE /identity/v3/users/37dbe6c4035042ec859505301d1f094d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:49.042018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.043555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:49.056954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80076730-6de7-4e02-a305-6e30b2d0cf46 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.068993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:49.117727 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.118295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.118596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.118856 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] PATH_INFO: `/v3/projects/e027b533f1214cc799cbfcb717a363a5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.120101 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e027b533f1214cc799cbfcb717a363a5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.122631 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.167802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e027b533f1214cc799cbfcb717a363a5', 'request_id': 'req-6d99bdf2-5883-497c-9d73-a01b1261fbcd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:49.173707 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e027b533f1214cc799cbfcb717a363a5', 'request_id': 'req-6d99bdf2-5883-497c-9d73-a01b1261fbcd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:49.179406 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e027b533f1214cc799cbfcb717a363a5', 'request_id': 'req-6d99bdf2-5883-497c-9d73-a01b1261fbcd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:49.192446 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] The token cache is being invalidate because project e027b533f1214cc799cbfcb717a363a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:00:49.192790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:49.193411 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d99bdf2-5883-497c-9d73-a01b1261fbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:00:49.194933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1408/2820] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:00:49 2022] DELETE /identity/v3/projects/e027b533f1214cc799cbfcb717a363a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:49.200427 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.200888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.201012 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.220591 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:49.222755 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:49.280512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1413/2821] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:49.288159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.288451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.288747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.308728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:49.309956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:49.318162 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1409/2822] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:49.322157 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.332282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1b635-ae00-4fc6-b15b-79e13eb2968b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.336778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.337380 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.337697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.337986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.338658 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:00:49.338965 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.340575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.351751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1414/2823] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:00:49.355700 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.364877 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97d16-5f3f-4656-9143-176da21a4b96 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.369566 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.370144 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.370430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.371236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.371933 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.373844 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.400017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1410/2824] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:49.404512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.414542 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54481595-3186-44f9-b3c3-132135815e4f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.470169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.470807 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.471114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.471390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.472056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.473987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.495324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1415/2825] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:49.499579 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.509875 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcfde-29f6-41ca-bbb5-aeadab33e6dd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.514984 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.515587 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.515874 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.516156 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.516846 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.518570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.529068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1411/2826] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:49.533026 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.542862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce61605-7dc9-45e4-bb9d-522055f2bacd admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.547435 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dfb97-063a-4b8b-8783-143d9ce32c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.548031 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dfb97-063a-4b8b-8783-143d9ce32c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.548314 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dfb97-063a-4b8b-8783-143d9ce32c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.548589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dfb97-063a-4b8b-8783-143d9ce32c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.549271 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dfb97-063a-4b8b-8783-143d9ce32c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.550916 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dfb97-063a-4b8b-8783-143d9ce32c75 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.561610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1416/2827] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:49.565729 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.576206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9158b-9854-418f-a8fb-04bf843739fd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.580876 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.581523 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.581926 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.582178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] PATH_INFO: `/v3/projects/10d4e8468da946aa9c9906f94bc3f0c1/users/e7588bddde934175a724f8e799de8fbd/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.597366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d4e8468da946aa9c9906f94bc3f0c1, user_id=e7588bddde934175a724f8e799de8fbd, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.600068 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.612180 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1412/2828] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:49 2022] PUT /identity/v3/projects/10d4e8468da946aa9c9906f94bc3f0c1/users/e7588bddde934175a724f8e799de8fbd/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:49.622113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.622483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.622768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.649832 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] MFA Rules not processed for user `e7588bddde934175a724f8e799de8fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:49.651039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:49.692813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:49.717746 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1417/2829] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:49.722241 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.766285 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:49.785148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1054-e96c-45eb-b4b5-39b94f2d0b35 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.789718 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.790320 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.790600 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.790871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.791517 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.793387 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.818745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1413/2830] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:49.822671 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.833775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c94c8-42ac-443d-adb8-7af67aa0283c None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.888398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.888945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.889283 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.889539 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.890234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.892140 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.912747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1418/2831] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:00:49 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:00:49.916752 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.927627 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8498599-0a01-47df-8b2c-2bc0abefa3dd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.932543 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.933237 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.933451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.933761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.934486 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.936082 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.946723 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1414/2832] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:49.950928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:49.961122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54233a1-20a2-4a00-a444-99bd155f7776 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:49.966248 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:49.966913 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:49.967199 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:49.967478 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] PATH_INFO: `/v3/projects/dfb6ba159b5a466c809cab45ff7e6ec1/users/304c286975694f6ba4c92412ff073acc/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:49.982465 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb6ba159b5a466c809cab45ff7e6ec1, user_id=304c286975694f6ba4c92412ff073acc, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:49.985332 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:49.998184 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1419/2833] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:49 2022] PUT /identity/v3/projects/dfb6ba159b5a466c809cab45ff7e6ec1/users/304c286975694f6ba4c92412ff073acc/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:50.004585 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:50.015056 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b72aa-43c6-4219-b6c0-f5960f7cc043 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:50.072131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4bff-0e84-4418-ae3e-a1fe3a301049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:50.072770 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4bff-0e84-4418-ae3e-a1fe3a301049 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:50.073017 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4bff-0e84-4418-ae3e-a1fe3a301049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:50.073295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4bff-0e84-4418-ae3e-a1fe3a301049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:50.074012 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4bff-0e84-4418-ae3e-a1fe3a301049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:50.075601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4bff-0e84-4418-ae3e-a1fe3a301049 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:50.085625 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1415/2834] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:00:50.090362 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:50.100490 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6952-960e-40ca-9a99-7f70f27e71ef admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:50.105687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:50.106344 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:50.106633 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:50.106917 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] PATH_INFO: `/v3/projects/dfb6ba159b5a466c809cab45ff7e6ec1/users/304c286975694f6ba4c92412ff073acc/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:50.108862 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb6ba159b5a466c809cab45ff7e6ec1, user_id=304c286975694f6ba4c92412ff073acc, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:50.111523 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:50.121443 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1420/2835] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:00:50 2022] PUT /identity/v3/projects/dfb6ba159b5a466c809cab45ff7e6ec1/users/304c286975694f6ba4c92412ff073acc/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:00:50.131267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:50.131561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:50.131842 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:50.159226 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] MFA Rules not processed for user `304c286975694f6ba4c92412ff073acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:00:50.160378 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:50.227799 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1416/2836] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:00:50.239745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:50.241498 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:00:50.304170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edc61f-0fb7-40a7-a920-0e13ee2ef199 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:50.308122 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:50.308733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:50.309022 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:50.309300 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:50.357666 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:50.368537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:50.370023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:50.378834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1421/2837] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:00:52.926793 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:00:52.937736 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46076f82-c619-4cf8-8dab-c8f0bef42468 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:00:52.943178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b377-6b12-4703-bfa6-b13e2883bfd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:00:52.944096 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b377-6b12-4703-bfa6-b13e2883bfd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:00:52.944440 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b377-6b12-4703-bfa6-b13e2883bfd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:00:52.944728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b377-6b12-4703-bfa6-b13e2883bfd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:00:52.956064 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b377-6b12-4703-bfa6-b13e2883bfd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:00:52.957520 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b377-6b12-4703-bfa6-b13e2883bfd5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:00:52.967822 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1417/2838] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:00:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:00.374835 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:02.962940 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:05.406132 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:05.467428 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc842867-b0a2-4969-bcb8-75d170db8bf0 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:05.471880 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:05.472507 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:05.472790 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:05.473064 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] PATH_INFO: `/v3/users/e7588bddde934175a724f8e799de8fbd` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:05.474213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7588bddde934175a724f8e799de8fbd)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:05.476113 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:05.523673 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7588bddde934175a724f8e799de8fbd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:05.530441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7588bddde934175a724f8e799de8fbd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:05.531096 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7588bddde934175a724f8e799de8fbd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:05.531697 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7588bddde934175a724f8e799de8fbd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:05.543343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7588bddde934175a724f8e799de8fbd'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:05.556334 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1422/2839] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:05 2022] DELETE /identity/v3/users/e7588bddde934175a724f8e799de8fbd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:05.561811 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:05.562295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:05.562408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:05.580820 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:05.582067 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:05.640458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1418/2840] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:05.649980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:05.651382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:05.708209 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8829b25-4154-4401-9977-7a733f27b12b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:05.712050 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:05.712660 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:05.712949 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:05.713229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:05.722118 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:05.723558 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:05.733531 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1423/2841] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:05.997658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:05.999124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:06.011239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5625-9062-436d-b43f-12946cd4ff28 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:06.017019 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:06.017755 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.017973 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.018364 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] PATH_INFO: `/v3/projects/10d4e8468da946aa9c9906f94bc3f0c1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.019541 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d4e8468da946aa9c9906f94bc3f0c1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:06.021555 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:06.070666 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d4e8468da946aa9c9906f94bc3f0c1', 'request_id': 'req-2ce21091-20f0-40d0-ab84-5006974c224c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.076722 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d4e8468da946aa9c9906f94bc3f0c1', 'request_id': 'req-2ce21091-20f0-40d0-ab84-5006974c224c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.082228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d4e8468da946aa9c9906f94bc3f0c1', 'request_id': 'req-2ce21091-20f0-40d0-ab84-5006974c224c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.095123 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] The token cache is being invalidate because project 10d4e8468da946aa9c9906f94bc3f0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:06.095407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.096029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.097512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1419/2842] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:05 2022] DELETE /identity/v3/projects/10d4e8468da946aa9c9906f94bc3f0c1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:06.101653 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:06.111665 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1895f8-6d70-4f8b-bb99-53140e9b636f service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:06.129006 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:06.168008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:06.168639 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.168918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.169192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] PATH_INFO: `/v3/users/304c286975694f6ba4c92412ff073acc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.170990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] RBAC: Authorizing `identity:delete_user(user_id=304c286975694f6ba4c92412ff073acc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:06.172869 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:06.216391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304c286975694f6ba4c92412ff073acc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.223595 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304c286975694f6ba4c92412ff073acc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.224239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304c286975694f6ba4c92412ff073acc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.224838 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304c286975694f6ba4c92412ff073acc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.236927 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-174ab94f-b822-45d2-a7e6-17f7a96a034f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304c286975694f6ba4c92412ff073acc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.249235 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1424/2843] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:06 2022] DELETE /identity/v3/users/304c286975694f6ba4c92412ff073acc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:06.517362 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:06.518835 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:06.537208 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21091-20f0-40d0-ab84-5006974c224c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:06.593194 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:06.593871 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.594145 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.594421 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] PATH_INFO: `/v3/projects/dfb6ba159b5a466c809cab45ff7e6ec1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.595589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb6ba159b5a466c809cab45ff7e6ec1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:06.597487 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:06.626132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:06.645929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb6ba159b5a466c809cab45ff7e6ec1', 'request_id': 'req-5a12f4c8-99cb-488f-bed1-207b607daf5e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.652384 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb6ba159b5a466c809cab45ff7e6ec1', 'request_id': 'req-5a12f4c8-99cb-488f-bed1-207b607daf5e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.659568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb6ba159b5a466c809cab45ff7e6ec1', 'request_id': 'req-5a12f4c8-99cb-488f-bed1-207b607daf5e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.671804 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] The token cache is being invalidate because project dfb6ba159b5a466c809cab45ff7e6ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:06.672076 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.672693 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a12f4c8-99cb-488f-bed1-207b607daf5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:06.674216 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1420/2844] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:06 2022] DELETE /identity/v3/projects/dfb6ba159b5a466c809cab45ff7e6ec1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:06.679153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.679637 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.679756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.700083 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:06.701205 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:06.762340 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1425/2845] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:06.770654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.770946 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.771246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.790262 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:06.791474 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:06.818119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1421/2846] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:06.822260 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:06.833694 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b617e5-b55e-45dc-bf42-89a3cd44da9d None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:06.838296 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:06.838905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.839192 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.839470 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] PATH_INFO: `/v3/domains` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.840168 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:01:06.840476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:06.842117 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:06.853947 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1426/2847] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:01:06.858374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:06.891024 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201f7f-95a7-469d-a53a-179d89a607ee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:06.896383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:06.896993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:06.897278 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:06.897556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:06.898252 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:06.900159 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:06.939429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1422/2848] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:06 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:06.943691 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:06.971101 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:06.986684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53f76-5c40-4ce3-91fd-216f6e2c3ada admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.041128 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.041768 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.042055 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.042333 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.042999 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.044907 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.072997 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1427/2849] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:06 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:07.074358 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.095247 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376d15-5058-434a-8ef8-5431b5251cf2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.099977 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.100580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.100866 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.101138 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.101843 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.103423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.113061 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1423/2850] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:07.117143 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.127085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a83114-55e6-4000-ad09-a7877c41f6cb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.131635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed8cc7-e530-4fe0-a95b-8821bc2d86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.132238 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed8cc7-e530-4fe0-a95b-8821bc2d86eb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.132522 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed8cc7-e530-4fe0-a95b-8821bc2d86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.132796 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed8cc7-e530-4fe0-a95b-8821bc2d86eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.133481 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed8cc7-e530-4fe0-a95b-8821bc2d86eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.135138 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed8cc7-e530-4fe0-a95b-8821bc2d86eb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.145776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1428/2851] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:07.149782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.160178 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c9450-073b-4006-83aa-7b8dd9bfb8d1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.164654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.165290 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.165571 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.165949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] PATH_INFO: `/v3/projects/ce90d1d86f9447989d2becbe05222f12/users/10a8beba1451489b926531806ac4e87d/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.180071 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90d1d86f9447989d2becbe05222f12, user_id=10a8beba1451489b926531806ac4e87d, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.183002 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.195376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1424/2852] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:07 2022] PUT /identity/v3/projects/ce90d1d86f9447989d2becbe05222f12/users/10a8beba1451489b926531806ac4e87d/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:01:07.207396 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.207692 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.208016 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.236087 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] MFA Rules not processed for user `10a8beba1451489b926531806ac4e87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:07.237290 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:07.299048 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1429/2853] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:07.303458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.354334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:07.364910 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5da2-85ee-4516-a04e-53fb95d0bb73 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.370287 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.370887 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.371167 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.371439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.372086 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.374023 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.399429 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1425/2854] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:07 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:07.403467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.414834 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11bf3e-cef3-46dd-9728-bcf5ad6933fd None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.471964 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.472574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.472855 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.473127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.473806 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.475701 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.485589 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:07.498758 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1430/2855] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:07 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:07.502647 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.512900 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6aa29-433f-424a-a988-dae66b648e75 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.518148 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.518745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.519029 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.519305 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.519989 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.521644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.531872 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1426/2856] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:07.535614 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.545335 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba916e-4e3c-4c0b-86f3-238726ff9e1e admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.550037 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.550667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.550945 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.551217 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] PATH_INFO: `/v3/projects/8bbd2ab068dd429da61fef97047a414c/users/c34317f0af4946c2b17940eddd4a2309/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.566285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbd2ab068dd429da61fef97047a414c, user_id=c34317f0af4946c2b17940eddd4a2309, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.568928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.582275 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1431/2857] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:07 2022] PUT /identity/v3/projects/8bbd2ab068dd429da61fef97047a414c/users/c34317f0af4946c2b17940eddd4a2309/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:07.586077 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.595890 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8cfb6-a792-43e8-87eb-59aa3e6b04ab admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.650449 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30100f67-e2e2-4b85-909b-71b17ef469c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.651057 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100f67-e2e2-4b85-909b-71b17ef469c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.651338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100f67-e2e2-4b85-909b-71b17ef469c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.651613 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100f67-e2e2-4b85-909b-71b17ef469c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.652294 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30100f67-e2e2-4b85-909b-71b17ef469c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.653916 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30100f67-e2e2-4b85-909b-71b17ef469c4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.663206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1427/2858] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:07.667379 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.677626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c73e-23df-46a3-8619-66b1515c611c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.682573 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.683228 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.683509 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.683783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] PATH_INFO: `/v3/projects/8bbd2ab068dd429da61fef97047a414c/users/c34317f0af4946c2b17940eddd4a2309/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.686266 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbd2ab068dd429da61fef97047a414c, user_id=c34317f0af4946c2b17940eddd4a2309, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.688890 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.699602 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1432/2859] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:07 2022] PUT /identity/v3/projects/8bbd2ab068dd429da61fef97047a414c/users/c34317f0af4946c2b17940eddd4a2309/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:01:07.710959 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.711254 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.711554 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.738267 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] MFA Rules not processed for user `c34317f0af4946c2b17940eddd4a2309`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:07.739480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:07.805745 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1428/2860] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:07.818617 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:07.820343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:07.884800 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e512-5b77-456e-9e00-3fbc62e2764b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:07.888480 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:07.889116 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:07.889399 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:07.889713 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:07.898635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:07.900056 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:07.909476 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1433/2861] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:08.220654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:08.229821 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f5fa4-d00b-4d9d-96d3-8a9a9f391e86 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:08.234999 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34317f0af4946c2b17940eddd4a2309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbd2ab068dd429da61fef97047a414c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:08.235610 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:08.235897 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:08.236175 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:08.236861 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:01:08.237171 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:08.238798 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:08.250119 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1429/2862] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:01:08.254121 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:08.263102 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8577-f01a-48a7-819c-a030856993c9 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:08.267742 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34317f0af4946c2b17940eddd4a2309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbd2ab068dd429da61fef97047a414c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:08.268343 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:08.268629 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:08.268910 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:08.269568 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:08.271513 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:08.298234 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1434/2863] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:08 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:08.302312 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:08.312396 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388fcaa-627b-4f0a-92a5-be07c08af662 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:08.345634 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:08.371923 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34317f0af4946c2b17940eddd4a2309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbd2ab068dd429da61fef97047a414c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:08.372560 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:08.372845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:08.373122 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:08.374466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:01:08.374779 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:08.376361 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:08.387867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1430/2864] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 29 05:01:08.425229 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:08.435686 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42452694-d814-431c-9894-07f7f51c24ea tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:08.440148 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34317f0af4946c2b17940eddd4a2309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbd2ab068dd429da61fef97047a414c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:08.440776 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:08.441063 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:08.441342 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] PATH_INFO: `/v3/projects/3c19cb247ece4189b12f6a1fc14f0399` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:08.442565 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c19cb247ece4189b12f6a1fc14f0399)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:08.444453 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:08.490041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c19cb247ece4189b12f6a1fc14f0399', 'request_id': 'req-05966cce-072f-46f0-be66-a04a302723fc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.497035 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c19cb247ece4189b12f6a1fc14f0399', 'request_id': 'req-05966cce-072f-46f0-be66-a04a302723fc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.502752 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c19cb247ece4189b12f6a1fc14f0399', 'request_id': 'req-05966cce-072f-46f0-be66-a04a302723fc'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.514361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] The token cache is being invalidate because project 3c19cb247ece4189b12f6a1fc14f0399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:08.514650 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.515293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-05966cce-072f-46f0-be66-a04a302723fc tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.516784 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1435/2865] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:08 2022] DELETE /identity/v3/projects/3c19cb247ece4189b12f6a1fc14f0399 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:08.719189 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:08.720967 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:08.788573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c038f3-ccfa-4dc4-9cff-10b2663d62f4 tempest-VolumeQuotaClassesTest-1552361527 tempest-VolumeQuotaClassesTest-1552361527-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:08.846135 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:08.846789 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:08.847075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:08.847353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] PATH_INFO: `/v3/users/10a8beba1451489b926531806ac4e87d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:08.848556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a8beba1451489b926531806ac4e87d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:08.850539 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:08.895556 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a8beba1451489b926531806ac4e87d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.902492 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a8beba1451489b926531806ac4e87d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.903633 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a8beba1451489b926531806ac4e87d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.904239 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a8beba1451489b926531806ac4e87d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.916772 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a8beba1451489b926531806ac4e87d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:08.920335 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:08.931245 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1431/2866] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:08 2022] DELETE /identity/v3/users/10a8beba1451489b926531806ac4e87d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:08.936578 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:08.936967 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:08.937124 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:08.959307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:08.960483 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:08.968467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:09.019756 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1436/2867] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:09.029415 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:09.030919 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:09.088377 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e89f-9380-430f-ade6-147132512c65 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:09.091924 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:09.092524 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:09.092802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:09.093075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:09.102619 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:09.104041 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:09.113399 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1432/2868] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:09.382278 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:09.383748 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:09.396627 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57585b-04bf-4121-8ea7-05d1a2c73e7b None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:09.401500 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:09.402174 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:09.402455 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:09.402740 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] PATH_INFO: `/v3/projects/ce90d1d86f9447989d2becbe05222f12` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:09.403886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce90d1d86f9447989d2becbe05222f12)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:09.406361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:09.452047 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce90d1d86f9447989d2becbe05222f12', 'request_id': 'req-79fc0be3-9086-4a22-b882-d46ee3739a15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.458098 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce90d1d86f9447989d2becbe05222f12', 'request_id': 'req-79fc0be3-9086-4a22-b882-d46ee3739a15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.463906 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce90d1d86f9447989d2becbe05222f12', 'request_id': 'req-79fc0be3-9086-4a22-b882-d46ee3739a15'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.476888 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] The token cache is being invalidate because project ce90d1d86f9447989d2becbe05222f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:09.477206 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.477873 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.479398 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1437/2869] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:09 2022] DELETE /identity/v3/projects/ce90d1d86f9447989d2becbe05222f12 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:09.483375 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:09.492869 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc540-cea1-48ed-a81e-201ed9060329 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:09.547621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:09.548176 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:09.548454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:09.548725 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] PATH_INFO: `/v3/users/c34317f0af4946c2b17940eddd4a2309` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:09.549938 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34317f0af4946c2b17940eddd4a2309)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:09.551833 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:09.596621 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34317f0af4946c2b17940eddd4a2309'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.603536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34317f0af4946c2b17940eddd4a2309'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.604181 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34317f0af4946c2b17940eddd4a2309'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.604782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34317f0af4946c2b17940eddd4a2309'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.616150 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6315ca12-27ea-496e-b61a-6eeb8eb4abfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34317f0af4946c2b17940eddd4a2309'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:09.628677 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1433/2870] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:09 2022] DELETE /identity/v3/users/c34317f0af4946c2b17940eddd4a2309 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:09.900914 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:09.902365 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:09.916909 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc0be3-9086-4a22-b882-d46ee3739a15 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:09.980073 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:09.980715 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:09.981003 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:09.981282 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] PATH_INFO: `/v3/projects/8bbd2ab068dd429da61fef97047a414c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:09.982518 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbd2ab068dd429da61fef97047a414c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:09.984962 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.026802 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:10.035946 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbd2ab068dd429da61fef97047a414c', 'request_id': 'req-038152ae-e661-45c3-b711-1cc40b73c4fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:10.042263 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbd2ab068dd429da61fef97047a414c', 'request_id': 'req-038152ae-e661-45c3-b711-1cc40b73c4fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:10.048482 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbd2ab068dd429da61fef97047a414c', 'request_id': 'req-038152ae-e661-45c3-b711-1cc40b73c4fa'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:10.061085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] The token cache is being invalidate because project 8bbd2ab068dd429da61fef97047a414c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:10.061374 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:10.062010 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-038152ae-e661-45c3-b711-1cc40b73c4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:10.063537 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1438/2871] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:09 2022] DELETE /identity/v3/projects/8bbd2ab068dd429da61fef97047a414c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:10.068499 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.068991 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.069093 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.089110 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:10.090546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:10.104963 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:10.153646 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1434/2872] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:10.162091 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.162390 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.162705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.182451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:10.183667 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:10.191607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1439/2873] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:10.197277 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.207405 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182102e3-9c98-4f44-9a81-4f326a4af105 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.211915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.212519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.212802 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.213075 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.213796 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:01:10.214125 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.215708 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.227448 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1435/2874] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:01:10.231560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.241306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf6d-4b78-41a2-b552-b0a33b2677bc None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.246061 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.246662 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.246948 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.247226 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.247886 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.250444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.278745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1440/2875] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:10.282797 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.292689 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ab035-a7c6-459d-bfd8-dd90a904e65f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.347104 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.347645 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.347929 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.348206 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.348852 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.350782 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.371808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1436/2876] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:10.376454 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.386896 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af285af5-aa67-4881-ab0d-9685d77ef400 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.391546 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.392154 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.392440 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.392716 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.393406 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.395023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.404989 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1441/2877] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:10.408832 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.418639 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df51a29-cc9c-42a0-bc3d-699a92b15b98 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.423737 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c975-f357-4d06-ac36-d1af77c6f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.424334 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c975-f357-4d06-ac36-d1af77c6f7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.424616 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c975-f357-4d06-ac36-d1af77c6f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.424892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c975-f357-4d06-ac36-d1af77c6f7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.425575 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c975-f357-4d06-ac36-d1af77c6f7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.427185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c975-f357-4d06-ac36-d1af77c6f7ae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.438596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1437/2878] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:10.442985 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.452824 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9f50f-e903-4cae-9d1a-9db16100afeb admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.457361 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.458032 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.458313 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.458587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] PATH_INFO: `/v3/projects/472188fe66e644c69dd0132f95b8120c/users/9fecf6d23fc54f9a89dd2305576bbff9/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.473419 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472188fe66e644c69dd0132f95b8120c, user_id=9fecf6d23fc54f9a89dd2305576bbff9, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.476111 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.488765 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1442/2879] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:10 2022] PUT /identity/v3/projects/472188fe66e644c69dd0132f95b8120c/users/9fecf6d23fc54f9a89dd2305576bbff9/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:01:10.499353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.499656 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.499953 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.527004 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] MFA Rules not processed for user `9fecf6d23fc54f9a89dd2305576bbff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:10.528212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:10.590719 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1438/2880] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:10.595321 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.655982 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cffbee-1e25-412a-b854-c7d6bbf8e5f2 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.660571 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.661177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.661467 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.661775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.662432 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.664308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.690285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1443/2881] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:10.694356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.705521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fabe5-789c-491d-ab6d-33e96afe57e7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.714234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:10.762497 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.763090 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.763374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.763654 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.764882 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.766819 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.787419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1439/2882] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:10 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:10.791421 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.802320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e4187-636a-41f5-9e5f-d2e7db64e69b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.807239 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.807842 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.808130 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.808411 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.809100 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.811353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.821797 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1444/2883] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:10.825701 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.835711 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688889d-e94a-493b-b53d-4871e0f8e676 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.840309 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.840955 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.841240 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.841518 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] PATH_INFO: `/v3/projects/cc546fa7bce24315b998d49421e67634/users/d3d14b2668d247d1a97bde8dff69b9f5/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.855824 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc546fa7bce24315b998d49421e67634, user_id=d3d14b2668d247d1a97bde8dff69b9f5, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.859036 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.871531 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1440/2884] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:10 2022] PUT /identity/v3/projects/cc546fa7bce24315b998d49421e67634/users/d3d14b2668d247d1a97bde8dff69b9f5/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:01:10.876041 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.885925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe18336-6fbf-48b1-bb59-966ff1648717 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.918711 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:10.944672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5bb9f-de81-4648-9f68-5cf97b11356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.945288 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5bb9f-de81-4648-9f68-5cf97b11356e admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.945562 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5bb9f-de81-4648-9f68-5cf97b11356e admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.945872 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5bb9f-de81-4648-9f68-5cf97b11356e admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.946572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5bb9f-de81-4648-9f68-5cf97b11356e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.948169 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5bb9f-de81-4648-9f68-5cf97b11356e admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.958039 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1445/2885] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:10.962224 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:10.972528 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9c569-820c-477c-aa51-aec3de0e5ee0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:10.977120 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:10.977810 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:10.978098 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:10.978379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] PATH_INFO: `/v3/projects/cc546fa7bce24315b998d49421e67634/users/d3d14b2668d247d1a97bde8dff69b9f5/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:10.980381 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc546fa7bce24315b998d49421e67634, user_id=d3d14b2668d247d1a97bde8dff69b9f5, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:10.983568 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:10.993679 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1441/2886] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:10 2022] PUT /identity/v3/projects/cc546fa7bce24315b998d49421e67634/users/d3d14b2668d247d1a97bde8dff69b9f5/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:11.004381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:11.004856 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:11.004958 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:11.031681 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] MFA Rules not processed for user `d3d14b2668d247d1a97bde8dff69b9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:11.032891 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:11.101683 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1446/2887] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:11.113754 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:11.115456 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:11.172635 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ad1a-60ee-4432-851c-6b233c8c5ac5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:11.176275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:11.176881 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:11.177190 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:11.177466 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:11.187146 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:11.188570 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:11.197845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1442/2888] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:11.270587 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:11.280737 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76eaf0-c6e3-4a53-99b4-5d102b225bd5 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:11.284353 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0a73c-eddc-4c0f-9353-4aaaeca2401b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:11.284954 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a73c-eddc-4c0f-9353-4aaaeca2401b service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:11.285237 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a73c-eddc-4c0f-9353-4aaaeca2401b service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:11.285514 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a73c-eddc-4c0f-9353-4aaaeca2401b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:11.340463 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a73c-eddc-4c0f-9353-4aaaeca2401b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:11.342446 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a73c-eddc-4c0f-9353-4aaaeca2401b service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:11.351213 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1447/2889] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:11.611655 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:11.672200 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a093-2a87-45cf-8238-56e75e1aafa2 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:11.676747 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:11.677311 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:11.677611 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:11.677894 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] PATH_INFO: `/v3/users/9fecf6d23fc54f9a89dd2305576bbff9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:11.679033 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fecf6d23fc54f9a89dd2305576bbff9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:11.680947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:11.691438 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:11.729169 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fecf6d23fc54f9a89dd2305576bbff9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:11.736248 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fecf6d23fc54f9a89dd2305576bbff9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:11.736909 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fecf6d23fc54f9a89dd2305576bbff9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:11.737508 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fecf6d23fc54f9a89dd2305576bbff9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:11.749347 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fecf6d23fc54f9a89dd2305576bbff9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:11.761885 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1443/2890] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:11 2022] DELETE /identity/v3/users/9fecf6d23fc54f9a89dd2305576bbff9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:11.766898 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:11.767175 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:11.767451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:11.786730 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:11.787926 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:11.836326 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=100 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:11.846606 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1448/2891] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:11.856318 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:11.857713 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:11.914443 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596d35b-1215-47fe-9e82-d85b7237a106 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:11.918080 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:11.918690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:11.918970 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:11.919242 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:11.928453 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:11.929886 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:11.940521 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1444/2892] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:12.215371 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:12.217382 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:12.229317 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c78b-25fb-4eb1-9565-2c28423bf2bb None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:12.234733 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:12.235384 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:12.235672 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:12.235952 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] PATH_INFO: `/v3/projects/472188fe66e644c69dd0132f95b8120c` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:12.237141 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=472188fe66e644c69dd0132f95b8120c)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:12.239177 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:12.286451 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472188fe66e644c69dd0132f95b8120c', 'request_id': 'req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.292620 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472188fe66e644c69dd0132f95b8120c', 'request_id': 'req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.298922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472188fe66e644c69dd0132f95b8120c', 'request_id': 'req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.310783 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] The token cache is being invalidate because project 472188fe66e644c69dd0132f95b8120c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:12.311065 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.311693 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.313195 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1449/2893] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:12 2022] DELETE /identity/v3/projects/472188fe66e644c69dd0132f95b8120c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:12.317307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:12.327419 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f57f4-c898-406e-99b3-faf0aca561f2 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:12.381423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:12.382083 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:12.382370 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:12.382648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] PATH_INFO: `/v3/users/d3d14b2668d247d1a97bde8dff69b9f5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:12.383808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d14b2668d247d1a97bde8dff69b9f5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:12.385762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:12.419271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:12.432637 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d14b2668d247d1a97bde8dff69b9f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.439368 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d14b2668d247d1a97bde8dff69b9f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.440073 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d14b2668d247d1a97bde8dff69b9f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.440683 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d14b2668d247d1a97bde8dff69b9f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.453372 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-148c4a81-be93-4c26-8733-03e7416e9848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d14b2668d247d1a97bde8dff69b9f5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.468949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1445/2894] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:12 2022] DELETE /identity/v3/users/d3d14b2668d247d1a97bde8dff69b9f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:12.736208 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:12.737749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:12.752990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7b43d-68be-41a0-b2a7-fa35cd75c214 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:12.810306 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:12.811506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:12.811789 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:12.812066 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] PATH_INFO: `/v3/projects/cc546fa7bce24315b998d49421e67634` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:12.813304 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc546fa7bce24315b998d49421e67634)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:12.815245 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:12.862512 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc546fa7bce24315b998d49421e67634', 'request_id': 'req-e83552a7-688c-4b91-813b-fb403032b182'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.868609 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc546fa7bce24315b998d49421e67634', 'request_id': 'req-e83552a7-688c-4b91-813b-fb403032b182'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.874603 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc546fa7bce24315b998d49421e67634', 'request_id': 'req-e83552a7-688c-4b91-813b-fb403032b182'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.886420 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] The token cache is being invalidate because project cc546fa7bce24315b998d49421e67634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:12.886705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.887327 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-e83552a7-688c-4b91-813b-fb403032b182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:12.889391 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1450/2895] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:12 2022] DELETE /identity/v3/projects/cc546fa7bce24315b998d49421e67634 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:12.894236 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:12.894522 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:12.894795 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:12.924108 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:12.925332 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:12.985323 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1446/2896] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:12.994194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:12.994485 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:12.994764 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.015078 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:13.016285 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:13.024187 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1451/2897] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:13.028379 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.038494 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0d89a-857c-4235-b1be-d17418f374ca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.043031 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.043658 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.043939 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.044213 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.044896 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 29 05:01:13.045785 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.047374 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.060291 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1447/2898] 10.222.0.46 () {58 vars in 1153 bytes} [Fri Jul 29 05:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 29 05:01:13.063270 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.068925 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:13.072778 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74ef9c-b960-4f97-9d47-21ea3ddc4321 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.079751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.080526 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.080981 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.081308 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.082147 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.084027 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.112560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1452/2899] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:13.116664 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.127151 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0934b1-d09f-425f-855d-20e5be3e2747 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.182617 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.183234 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.183519 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.183800 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.184458 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.187013 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.208018 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1448/2900] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:13.212265 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.222607 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8456a4-dab5-494c-b53a-1a5412fe9f05 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.227284 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.227887 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.228170 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.228449 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.229136 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.230859 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.241389 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1453/2901] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:13.245060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.255188 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e0a4d-79a2-4864-99f3-2a72f4f5b342 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.259786 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44841a9-ebd7-411b-b7b3-01d4345aab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.260383 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44841a9-ebd7-411b-b7b3-01d4345aab01 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.260672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44841a9-ebd7-411b-b7b3-01d4345aab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.260948 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44841a9-ebd7-411b-b7b3-01d4345aab01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.261659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44841a9-ebd7-411b-b7b3-01d4345aab01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.263271 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44841a9-ebd7-411b-b7b3-01d4345aab01 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.274132 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1449/2902] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 29 05:01:13.278153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.288574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cad8d-a3dc-487b-a922-3e951f6562f6 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.293153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.293875 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.294194 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.294519 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] PATH_INFO: `/v3/projects/ed84935c5951400aa8dbd74980134a61/users/17379c2dabce4d23a76ae26bc6010b66/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.309705 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed84935c5951400aa8dbd74980134a61, user_id=17379c2dabce4d23a76ae26bc6010b66, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.312973 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.325635 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1454/2903] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:13 2022] PUT /identity/v3/projects/ed84935c5951400aa8dbd74980134a61/users/17379c2dabce4d23a76ae26bc6010b66/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:01:13.335851 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.336353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.336463 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.349506 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:13.365338 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] MFA Rules not processed for user `17379c2dabce4d23a76ae26bc6010b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:13.366601 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:13.429972 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1450/2904] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:13.434663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.495780 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582efbd2-4269-4b7f-88ad-9bb37e18f0db admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.500381 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.500990 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.501276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.501555 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.502246 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.504167 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.530241 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1455/2905] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:13.534502 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.545074 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb0306-17ea-4f50-8d9c-d561bc337431 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.599561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.600168 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.600451 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.600728 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.601386 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.603329 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.624376 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1451/2906] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:13.628649 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.638974 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9d7a-e2b0-45cf-9c50-2805c23e6e3c admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.643575 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.644180 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.644466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.644745 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.645433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.647085 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.658166 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1456/2907] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:13.661892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.672258 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47642707-ceb6-4e9c-b036-d5fa03ac0e4e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.676761 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d45bf-3ac1-446c-af2d-08ca121ebd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.677356 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d45bf-3ac1-446c-af2d-08ca121ebd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.677672 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d45bf-3ac1-446c-af2d-08ca121ebd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.677960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d45bf-3ac1-446c-af2d-08ca121ebd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.678648 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d45bf-3ac1-446c-af2d-08ca121ebd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.680218 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d45bf-3ac1-446c-af2d-08ca121ebd3d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.690116 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1452/2908] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:13.693902 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.703663 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a736-c1de-4cbe-90f4-87f4e571ca7f admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.708281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.708966 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.709252 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.709532 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] PATH_INFO: `/v3/projects/09d2c9bd5f934372bb9754c075b4fc55/users/9af02112932a4031a95374c3398b4565/roles/696d13ce411c44db98ea6d86268618d9` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.724613 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d2c9bd5f934372bb9754c075b4fc55, user_id=9af02112932a4031a95374c3398b4565, role_id=696d13ce411c44db98ea6d86268618d9)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.727293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.739688 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1457/2909] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:13 2022] PUT /identity/v3/projects/09d2c9bd5f934372bb9754c075b4fc55/users/9af02112932a4031a95374c3398b4565/roles/696d13ce411c44db98ea6d86268618d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:13.750439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.750784 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.751070 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.778212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] MFA Rules not processed for user `9af02112932a4031a95374c3398b4565`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:13.779439 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:13.844749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1453/2910] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:13.849272 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.906922 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:13.911131 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016492bd-592b-4b2a-b5d9-46b4c75777dc admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:13.917072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:13.917718 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:13.918008 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:13.918315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:13.918986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:13.921441 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:13.951574 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1458/2911] 10.222.0.46 () {60 vars in 1153 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:13.955806 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:13.962542 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:13.966907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7102154-1df5-49cc-8b31-3128d536e157 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:14.023512 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:14.024154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.024433 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.024705 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.025369 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:14.027325 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:14.048480 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1454/2912] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 29 05:01:13 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 29 05:01:14.052528 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:14.063825 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1af7-71d7-42b5-864f-354a4ebbe54a admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:14.068414 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:14.069023 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.069307 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.069904 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.070320 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:14.071915 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:14.082929 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1459/2913] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:14.086849 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:14.097536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ffb6-5bd3-4cff-808a-9c97985e50a7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:14.102392 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:14.103060 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.103412 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.103743 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] PATH_INFO: `/v3/projects/f06e006404be4670af760773d17c50bb/users/7e8ce59b47da47f38b27cd9c889fbae3/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.118485 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06e006404be4670af760773d17c50bb, user_id=7e8ce59b47da47f38b27cd9c889fbae3, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:14.121131 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:14.133349 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1455/2914] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:14 2022] PUT /identity/v3/projects/f06e006404be4670af760773d17c50bb/users/7e8ce59b47da47f38b27cd9c889fbae3/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:14.137324 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:14.147813 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6cfe-70b6-464e-827a-ba263d90837b admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:14.203830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ab501-39c8-47c7-b818-72bc5b30237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:14.204444 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab501-39c8-47c7-b818-72bc5b30237f admin admin] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.204728 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab501-39c8-47c7-b818-72bc5b30237f admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.205002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab501-39c8-47c7-b818-72bc5b30237f admin admin] PATH_INFO: `/v3/roles` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.205721 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ab501-39c8-47c7-b818-72bc5b30237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:14.207302 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ab501-39c8-47c7-b818-72bc5b30237f admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:14.216787 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1460/2915] 10.222.0.46 () {58 vars in 1122 bytes} [Fri Jul 29 05:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 29 05:01:14.220954 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:14.231079 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e8496-03c6-4dab-84df-4583c281fd3c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:14.235599 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:14.236249 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.236530 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.236809 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] PATH_INFO: `/v3/projects/f06e006404be4670af760773d17c50bb/users/7e8ce59b47da47f38b27cd9c889fbae3/roles/cd27725d1b194f6eb7cf2f66863bddfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.238790 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06e006404be4670af760773d17c50bb, user_id=7e8ce59b47da47f38b27cd9c889fbae3, role_id=cd27725d1b194f6eb7cf2f66863bddfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:14.241408 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:14.252589 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1456/2916] 10.222.0.46 () {60 vars in 1483 bytes} [Fri Jul 29 05:01:14 2022] PUT /identity/v3/projects/f06e006404be4670af760773d17c50bb/users/7e8ce59b47da47f38b27cd9c889fbae3/roles/cd27725d1b194f6eb7cf2f66863bddfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:14.263276 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] REQUEST_METHOD: `POST` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.264447 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.264552 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.291466 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.auth.core [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] MFA Rules not processed for user `7e8ce59b47da47f38b27cd9c889fbae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:14.292610 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:14.358905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1461/2917] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:14.370035 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:14.371831 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:14.440139 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5284-c8f8-415c-ba73-edd40e46e60d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:14.443801 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:14.444407 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:14.444690 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:14.444964 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:14.499489 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:14.500907 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:14.509644 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1457/2918] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:15.999792 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:16.001294 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:16.013114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3c5fd-0e6e-48ce-8063-db7f3cd9ae92 None None] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:16.016626 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:16.017223 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:16.017503 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:16.017811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:16.065416 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:16.075417 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:16.077486 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:16.086590 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1462/2919] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:16.612615 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:16.616659 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:16.622873 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cab878-1aef-4654-9879-1f82b9fb4ef2 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:16.627389 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f09481-5fa0-4d3a-b6db-220028fa7435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18adc9c4a6514351ba0d9df140578a73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:16.627993 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f09481-5fa0-4d3a-b6db-220028fa7435 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:16.628282 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f09481-5fa0-4d3a-b6db-220028fa7435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:16.628590 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f09481-5fa0-4d3a-b6db-220028fa7435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:16.637454 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f09481-5fa0-4d3a-b6db-220028fa7435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:16.639546 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f09481-5fa0-4d3a-b6db-220028fa7435 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:16.648808 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1458/2920] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:20.510506 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:20.571986 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2797-d045-4552-a30a-31ec63770ed0 service cinder] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:20.576882 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:20.577540 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:20.577853 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:20.578127 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] PATH_INFO: `/v3/users/17379c2dabce4d23a76ae26bc6010b66` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:20.579289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17379c2dabce4d23a76ae26bc6010b66)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:20.581210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:20.625849 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17379c2dabce4d23a76ae26bc6010b66'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:20.632775 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17379c2dabce4d23a76ae26bc6010b66'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:20.633433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17379c2dabce4d23a76ae26bc6010b66'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:20.634068 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17379c2dabce4d23a76ae26bc6010b66'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:20.646376 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17379c2dabce4d23a76ae26bc6010b66'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:20.659749 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1463/2921] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:20 2022] DELETE /identity/v3/users/17379c2dabce4d23a76ae26bc6010b66 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:20.664185 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359409d-c330-44a0-83be-2d64c075892f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:20.664673 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359409d-c330-44a0-83be-2d64c075892f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:20.664774 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359409d-c330-44a0-83be-2d64c075892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:20.691228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4359409d-c330-44a0-83be-2d64c075892f None None] MFA Rules not processed for user `3b17a7a10c4d4b0096fc893a4bc53a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 29 05:01:20.692348 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4359409d-c330-44a0-83be-2d64c075892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:20.751078 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1459/2922] 10.222.0.46 () {58 vars in 958 bytes} [Fri Jul 29 05:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 29 05:01:20.760723 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:20.762153 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:20.818215 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5f30-b226-4c07-85ae-1c6a00d6b554 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:20.821830 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ea656c169243b9ac9319cb77bd4875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:20.822433 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:20.822710 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:20.822980 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:20.832002 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:20.833442 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:20.842777 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1464/2923] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:01:21.100947 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359409d-c330-44a0-83be-2d64c075892f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:21.102430 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4359409d-c330-44a0-83be-2d64c075892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:21.118275 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359409d-c330-44a0-83be-2d64c075892f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:21.123911 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:21.124561 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:21.124845 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:21.125124 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] PATH_INFO: `/v3/projects/ed84935c5951400aa8dbd74980134a61` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:21.126307 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed84935c5951400aa8dbd74980134a61)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:21.128212 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:21.174423 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed84935c5951400aa8dbd74980134a61', 'request_id': 'req-c89d05f2-b819-4c04-b00a-41cfaafcbae6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.180436 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed84935c5951400aa8dbd74980134a61', 'request_id': 'req-c89d05f2-b819-4c04-b00a-41cfaafcbae6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.186949 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed84935c5951400aa8dbd74980134a61', 'request_id': 'req-c89d05f2-b819-4c04-b00a-41cfaafcbae6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.198867 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] The token cache is being invalidate because project ed84935c5951400aa8dbd74980134a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:21.199154 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.199762 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.201915 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1460/2924] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:21 2022] DELETE /identity/v3/projects/ed84935c5951400aa8dbd74980134a61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:21.205905 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:21.215572 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4346dc1-027d-47de-9e4f-6fe8b296a383 service neutron] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:21.224700 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:21.273827 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:21.274516 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:21.274799 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:21.275072 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] PATH_INFO: `/v3/users/9af02112932a4031a95374c3398b4565` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:21.276210 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af02112932a4031a95374c3398b4565)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:21.278161 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:21.323075 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af02112932a4031a95374c3398b4565'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.329818 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af02112932a4031a95374c3398b4565'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.330494 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af02112932a4031a95374c3398b4565'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.331095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af02112932a4031a95374c3398b4565'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.342928 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af02112932a4031a95374c3398b4565'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.355084 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1465/2925] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:21 2022] DELETE /identity/v3/users/9af02112932a4031a95374c3398b4565 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:21.622228 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:21.624295 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:21.637749 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d05f2-b819-4c04-b00a-41cfaafcbae6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:21.694956 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:21.695596 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:21.695880 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:21.696158 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] PATH_INFO: `/v3/projects/09d2c9bd5f934372bb9754c075b4fc55` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:21.697366 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d2c9bd5f934372bb9754c075b4fc55)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:21.699331 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:21.707051 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:21.746353 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d2c9bd5f934372bb9754c075b4fc55', 'request_id': 'req-b6dbac52-c18f-4197-95ce-255e97b621f4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.752787 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d2c9bd5f934372bb9754c075b4fc55', 'request_id': 'req-b6dbac52-c18f-4197-95ce-255e97b621f4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.758246 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d2c9bd5f934372bb9754c075b4fc55', 'request_id': 'req-b6dbac52-c18f-4197-95ce-255e97b621f4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.770651 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] The token cache is being invalidate because project 09d2c9bd5f934372bb9754c075b4fc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:21.770941 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.771574 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.773058 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1461/2926] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:21 2022] DELETE /identity/v3/projects/09d2c9bd5f934372bb9754c075b4fc55 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:21.777233 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:21.778687 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:21.791707 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6cc2b-5c57-4816-a516-28a5cc7b6070 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:21.849315 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:21.849987 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:21.850281 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:21.850586 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] PATH_INFO: `/v3/users/7e8ce59b47da47f38b27cd9c889fbae3` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:21.851751 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8ce59b47da47f38b27cd9c889fbae3)` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:21.853689 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:21.889811 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:21.900316 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8ce59b47da47f38b27cd9c889fbae3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.907837 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8ce59b47da47f38b27cd9c889fbae3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.908487 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8ce59b47da47f38b27cd9c889fbae3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.909095 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8ce59b47da47f38b27cd9c889fbae3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.922114 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.notifications [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8ce59b47da47f38b27cd9c889fbae3'} {{(pid=80397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:21.936293 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1466/2927] 10.222.0.46 () {58 vars in 1224 bytes} [Fri Jul 29 05:01:21 2022] DELETE /identity/v3/users/7e8ce59b47da47f38b27cd9c889fbae3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 29 05:01:22.209197 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:01:22.210685 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:01:22.224971 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbac52-c18f-4197-95ce-255e97b621f4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:01:22.281573 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b17a7a10c4d4b0096fc893a4bc53a62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3845060db6a456e8e10c94484cbc67c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:01:22.282170 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:01:22.282457 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:01:22.282735 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] PATH_INFO: `/v3/projects/f06e006404be4670af760773d17c50bb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:01:22.283892 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06e006404be4670af760773d17c50bb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:01:22.285841 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:01:22.333420 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06e006404be4670af760773d17c50bb', 'request_id': 'req-b09edd7b-1a12-4d32-80a6-495a1ac8f902'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:22.339536 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06e006404be4670af760773d17c50bb', 'request_id': 'req-b09edd7b-1a12-4d32-80a6-495a1ac8f902'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:22.345773 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06e006404be4670af760773d17c50bb', 'request_id': 'req-b09edd7b-1a12-4d32-80a6-495a1ac8f902'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:22.357676 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] The token cache is being invalidate because project f06e006404be4670af760773d17c50bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 29 05:01:22.357960 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:22.358580 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b09edd7b-1a12-4d32-80a6-495a1ac8f902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 29 05:01:22.360059 dv-cinder-851449-2-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1462/2928] 10.222.0.46 () {58 vars in 1233 bytes} [Fri Jul 29 05:01:22 2022] DELETE /identity/v3/projects/f06e006404be4670af760773d17c50bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 29 05:01:31.934289 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:32.354623 dv-cinder-851449-2-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:02:19.698608 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Authenticating user token {{(pid=80397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 29 05:02:19.700074 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:02:19.793763 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661012d4-55f1-45b5-8178-cf3b3e7a99a4 admin admin] Validating token access rules against request {{(pid=80397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 29 05:02:19.851918 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69d05210f0894bec881969d3ae3ad4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a55e2cd3f5e44abcbb6c908a7d8552fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 29 05:02:19.852560 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] REQUEST_METHOD: `GET` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 29 05:02:19.852845 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] SCRIPT_NAME: `/identity` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 29 05:02:19.853747 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 29 05:02:19.855536 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.fernet_utils [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 29 05:02:19.866568 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 29 05:02:19.868137 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9f8d-e2df-475b-8e27-16dbac083585 service placement] RBAC: Authorization granted {{(pid=80397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 29 05:02:19.877979 dv-cinder-851449-2-smb devstack@keystone.service[80397]: [pid: 80397|app: 0|req: 1467/2929] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 29 05:02:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 29 05:02:29.873684 dv-cinder-851449-2-smb devstack@keystone.service[80397]: DEBUG dbcounter [-] [80397] Writing DB stats keystone:SELECT=67 {{(pid=80397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}